What we can learn from Plasma telemetry

Since Plasma 5.18, about 7 months ago, Plasma has shipped with a telemetry system. Opt in (i.e off by default) it requires users to go to choose if (and how much) data to send to us.
No private or identifying information is sent, and everything is stored inline with our privacy policy.

Currently we have hit just shy of 100,000 updates!

We have started off requesting very little information. Versions, GPU info and some basic screen information. However the library powering this is extremely powerful and capable of so much more that we can try and build on in the future to try and identify weak areas and areas we need to invest time and effort and also to identify features or platforms that maybe are under utilised and can be dropped.

I have recently been trying to improve on how we can extract and visaulise data from the data collected and draw some conclusions. I want to present some of the aggregated metrics.

What we can learn from Plasma statistics

Used Plasma Versions

To explain our numerical versioning additons.
.80 = git master before the next version, up until the beta
.90 = after the stable branch forks for release up until the next.0 release.

LTS

The biggest surprise is that LTS is currently only used by around 5% of people with 93% of reporting users on the lastest stable (5.19)

At the current rate it does make me question whether the LTS is worth it. Maybe LTS will only gain traction when the next LTS distro gets a release which could come later?

Obviously any decision will only be made as the result of a discussion with all stakeholders, but this is definitely raising questions.

Testing

Right now about 1.5% of people run master, I had expected those users to be the most into helping with the telemetry and skew this further.
The bigger surprise is the number of people running master seems to fluctuate. Weekly users can go between 30-60. I had expected this to be constant.

It is comforting to see that betas do get more users, going up to 2.5% of our reporting userbase.

Interesting observations

There is one person who is still activitly using Plasma 5.18 beta. Not 5.18, the beta for 5.18.. which was 8 months ago.
I have so many questions.

Screens

800x600 resolution setups are still a thing we need to support, even if they are just VMs they're still used. This is very relevant as we often get commits blindly setting a minimum size hint of a window to be bigger because it "looks nicer". I now know I do still need to ensure in review that we don't break these setups.

We also see that ultrawide monitors are surprisingly unpopular despite clearly being the best monitor setup possible.

Graphic drivers

The graph is pretty self-explanatory, Intel has the most, but the Nvidia proprietory driver comes in at ~1/4 of the total users.
It makes it an important target to support as best as we can even if it comes with its share of problems.

My personal setup doesn't match your conclusions!

The reason we want to use telemetrics is to drive decisions with real data.

As a user you are more than welcome to choose to opt into the statistics or not, we understand privacy is important which is why everything is opt-in only.
However, real decisions will ultimately be based on the data we have available, if you want your usecases to be noted, please do consider submitting to the telemetry to us.
To enable telemetry please go to "System Settings" and select the "User Feedback" tab.

38 thoughts on “What we can learn from Plasma telemetry”

  1. A new user must find this feature in a complex options. It would be better I think to have a window opened when the user first log into the session, proposing to activate the telemetry. I think it would make this feature more visible, and the more the data the best the information which can be extracted from (sorry for my english, not my first language).

      1. The 0ad project has a good balance between intrusiveness and telemetry encouragement. They are also very clear about what data is being sent, you can see and modify it.

  2. LTS would most likely have an audience in e.g. corporate deployments where the IT department may well make sure telemetry cannot be enabled or communicate, though, or the user would be shy to enable it.

  3. > The biggest surprise is that LTS is currently only used by around 5% of people with 93% of reporting users on the lastest stable (5.19)

    Come on. The anwser to this question ist almost trivial. Mostly private users, who are very interested in this desktop solution – I didn’t drop the term fanboy – did I!? – ever turn this telemetry service on. Everyone else either doesn’t know about it or won’t ever enable it (coporate or anyone else caring about her or his privacy).

    This dataset is inherently skewed.

  4. Hey, thanks for making this fully opt-in instead of opt-out. Of course I opted all the way in, and I hope everyone does the same, simply because you can be trusted.

  5. What if Plasma enables telemetry by default?. Showing a clear notification after Plasma installation, where you click and it explains you why it is enabled, how it collects the data and how to disable it (or/and add a button to disable it). And when people choose disable it, ask them if the reason is being a corporate deployment or privacy concerns and collect just if it is an LTS version.

    1. I am strongly opposed to an opt-out solution and I am certain that this would be a no-go for most users. If you want opt-out you may go to Google, Microsoft, etc. 😉

      Making it more discoverable and as transparent as possible is the right way to go.

      1. Ok, most of you don like opt-in solution. I trust KDE thats why I suggested an opt-out solution, in a very clear and transparent way.

        Nevermind, I agree with you on “Making it more discoverable and as transparent as possible is the right way to go.”

  6. Reading your blog post motivated me to look how I can turn on telemetry on my system, and I learned that KUserFeedback unfortunately seems not to be included at all in Kubuntu 20.04 (with Plasma 5.18).
    So I think data of users of Kubuntu will be lacking in the feedback collected so far?

  7. I’m all for opt-in telemetry – sadly, I can’t seem to find the “User Feedback” section in System Settings on Kubuntu 20.04 LTS. Since I upgraded from 19.10 using the release upgrader, it could be possible a package got missed.

    Otherwise, I agree with the points made above – those who are likely to use an LTS probably aren’t the sort to actively seek out and enable this. I think a gentle prompt (perhaps akin to the Plasma Browser Integration notification) would go a long way. Just make sure it’s unobtrusive and dismissable – and perhaps also wait a few days (1 week?) after first run before showing the notification, so users aren’t bombarded the moment they try out KDE.

    1. I think the installer would be a better place? Though most probably only realizable on kde specific distros such as kubuntu / neon?
      Right at the end, either when it shows the “slideshow” of features (though on some installs that’s not there for a long time 😉 or maybe on the “finished” screen.

  8. I turned on telemetry some time ago after reading another KDE article similar to this one. I also turned on telemetry on several other KDE programs as well. It would be nice to see all the KDE world of apps centralize this functionality in the System Settings page. A one stop shop for enabling and disabling telemetry for all the apps making it easier to find, use, and less cumbersome for the user to hunt through each app looking for this option.

    Thanks and keep up the good work!

  9. > To enable telemetry please go to “System Settings” and select the “User Feedback” tab.

    Can’t find anything like that here (Kubuntu 20.04, plasma 5.18.5). System settings don’t have any tabs (maybe had before the ui change? I don’t remember anymore ;), searching for feedback gives only launch feedback, configuration for the app itself only has the icon/sidebar view switch…

  10. Hi,
    I wonder, what values KMail is sending here about my screen setup. While my setup is actually a 3840×2160 and 1280×1024 screen the “show raw data” button on the lower right corner shows this:

    “screens”: [
    {
    “dpi”: 109,
    “height”: 1440,
    “width”: 2560
    },
    {
    “dpi”: 58,
    “height”: 683,
    “width”: 853
    }

    What unit is kuserfeedback using here? Or is this a bug elswhere, as KMail is doing strange things here on my dual display setup. Unfortunately I have no such button for the plasma user feedback.