Losing Campaign Tracking and user segment data at scale

Hi. I love Piwik and have been using it on for four years but…

We have a self hosted implementation of Piwik and I’m the guy that needs the data, not the brains behind the operation, My problem is that User Segmentation does not seem to be working for me at scale. When I segment, the system takes forever (if ever) to work out my data and when (if) it does it’s clearly wrong.

Here is a sample of othe piwik code on our site. "Usr variable changes depending on wherther a user is logged in, a paying customer etc. (It won’t take a genius to wrk out the site, but out of respect to the forum I Examplified the domain).

Now if I try to find users in (say) Germany with the Usr variable “S” in segments, It crashes or returns a number roughly = 100% of users.

On a separate but related issue, if I link to a page with (say) Example Domain I get a fraction of the data that I should, even when I manually do the click via a proxy.

So I seem to be dropping data. Is it me, or is it the scale of traffic to the site? (The site is pretty big by anyone’s standards).

Any help greatly appreciated - including directing me to some professional services support.

Hi there,

Sure Segment performance at scale is a challenge. However there is a solution to this, it is to set Segments to be PRE-PROCESSED. This is an option in the segment editor screen when editing a segment. Then your cron task will automatically pre-process those segments data. See: http://piwik.org/docs/setup-auto-archiving/

On a separate but related issue, if I link to a page with (say) example.com/?pk_campaign=advert&pk_kwd=twitter I get a fraction of the data that I should, even when I manually do the click via a proxy.

See: http://piwik.org/faq/troubleshooting/faq_51/
Or possibly this feature request: https://github.com/piwik/piwik/issues/2624

Any help greatly appreciated - including directing me to some professional services support.

Sure feel free to contact Piwik support or ask further here