^ I'm never sure whether the target of the review is implied by the task's tags, i.e. whether the OCG was implied by OCG-General.

Here's a list of initial questions prioritized for each feature. I'm assuming we'll only be able to get some of these using grafana.

Single-article PDFs

Questions:

• Is there a significant decrease in renders after switching to Electrion options on all projects?
• How often do users abandon the workflow with the double-column option?
• How often do users render pdfs multiple times within a single session?
• Are anons rendering more/less than logged-in users?
• What is the average session depth for users that render pdfs?
• Which are the most rendered articles?
• Which are the most rendered categories of articles?

*Total clicks to the print to pdf option? daily, monthly
*Total clicks to the single-column option? daily, monthly
*Total clicks to the double-column option? daily, monthly
*Total clicks to the double-column option that render the final PDF? daily, monthly

Uniques for all of the above

Books

Questions:

• Is there a significant decrease in renders after switching to Electron for all projects?
• How often do users abandon the book creation workflow and at which parts of the workflow?
• How often do users use the features: chapter creation, title, subtitle, paper size
• Are anons rendering more/less books than logged-in users?
• What is the average session depth for users that render books?
• What are the most popular articles added to books?
• What are the most popular categories of articles added to books?

*Total clicks to on create a book? daily, monthly
*Total books downloaded using OCG
*Total books downloaded using Electron
*Total launches of the book creator (“start book”)? daily, monthly
*Total creation of books with at least 1 article? daily, monthly
*Total entries to title field
*Total chapters created

Uniques for all of the above

In T174437#3569655, @ovasileva wrote:

Here's a list of initial questions prioritized for each feature. I'm assuming we'll only be able to get some of these using grafana.

I think we can certainly plot all of those things in Grafana. I know we haven't instrumented them though.

Single-article PDFs

Questions:

• Is there a significant decrease in renders after switching to Electrion options on all projects?

The number of renders/day are plotted here: https://grafana.wikimedia.org/dashboard/db/mediawiki-electronpdfservice?orgId=1&panelId=4&fullscreen

• Total clicks to the print to pdf option? daily, monthly

This is plotted here: https://grafana.wikimedia.org/dashboard/db/mediawiki-electronpdfservice?orgId=1&panelId=1&fullscreen

• Total clicks to the single-column option? daily, monthly
• Total clicks to the double-column option? daily, monthly

These are plotted here ("redirect_to_electron" and "redirect_to_collection respectively): https://grafana.wikimedia.org/dashboard/db/mediawiki-electronpdfservice?orgId=1&panelId=2&fullscreen

Books

Questions:

• Is there a significant decrease in renders after switching to Electron for all projects?

As above, the number of renders/day are plotted here: https://grafana.wikimedia.org/dashboard/db/mediawiki-electronpdfservice?orgId=1&panelId=4&fullscreen

• The number of books downloaded using OCG.

This is plotted here ("download_file"): https://grafana.wikimedia.org/dashboard/db/ocg?panelId=6&fullscreen&orgId=1

@ovasileva: I've got questions about your questions:

• Which questions from T174437#3569655, if any, would block the deployment of Proton?
• Which questions, if any, are related to follow-up changes to Proton (e.g. UI changes that we want to make after we've decommissioned OCG?).

Simply put, we're not going to answer all of those questions. If we could relate the questions to planned future work, then I think it'd be easier to whittle down the list.

I would say the minimum would be the following (no additional fields needed in grafana, just additional charts that separate books and single renders):

single article
Questions - how often do users use print to pdf daily and monthly for each renderer?

• Total clicks to the print to pdf option? daily, monthly (selection screen views, plus the same monthly)
• Total clicks to the single-column option? daily, monthly (redirect selection, plus the same graph monthly)
• Total clicks to the double-column option? daily, monthly (redirect selection, plus the same graph monthly)

books
Question - how often do users use the books feature daily and monthly for each renderer?

• Total clicks to create a book (main page of special book (daily, monthly) - will need new graph
• Total books rendered by Electron - will need new graph (or can be added to redirect selection)
• Total books rendered by OCG - will need new graph (basically, what PDF rendering over time daily is right now, except only showing for books)

@phuedx - not required but nice to have - can we use graphana to track unique views?

In T174437#3578034, @ovasileva wrote:

@phuedx - not required but nice to have - can we use graphana to track unique views?

No, AFAIK.

@ovasileva to sign this off since T175166: Cleanup and update Electron PDF Service grafana board has been created.