django-tracking2 tracks the length of time visitors and registered users spend on your site. Although this will work for websites, this is more applicable to web _applications_ with registered users. This does not replace (nor intend) to replace client-side analytics which is great for understanding aggregate flow of page views.
License: BSD 2-Clause "Simplified" License
Currently, the VisitorManager.stats and PageviewManager.stats methods are a tad monolithic. These should be broken up for clarity and for more easily adding new aggregation methods.
On Executing / page i get error
tracking_visitor.ip_address may not be NULL . other details below
Environment:
Request Method: GET
Request URL: http://127.0.0.1:8000/
Django Version: 1.6.5
Python Version: 2.7.5
Installed Applications:
('django.contrib.admin',
'django.contrib.auth',
'django.contrib.contenttypes',
'django.contrib.sessions',
'django.contrib.messages',
'django.contrib.staticfiles',
'django.contrib.admin',
'django.contrib.sitemaps',
'django.contrib.sites',
'tracking')
Installed Middleware:
('tracking.middleware.VisitorTrackingMiddleware',
'django.contrib.sessions.middleware.SessionMiddleware',
'django.middleware.common.CommonMiddleware',
'django.middleware.csrf.CsrfViewMiddleware',
'django.contrib.auth.middleware.AuthenticationMiddleware',
'django.contrib.messages.middleware.MessageMiddleware',
'django.middleware.clickjacking.XFrameOptionsMiddleware')
Traceback:
File "C:\Python2.7.5\lib\site-packages\django\core\handlers\base.py" in get_response
response = middleware_method(request, response)
visitor = self._refresh_visitor(user, request, now)
visitor.save()
force_update=force_update, update_fields=update_fields)
updated = self._save_table(raw, cls, force_insert, force_update, using, update_fields)
result = self._do_insert(cls._base_manager, using, fields, update_pk, raw)
using=using, raw=raw)
return insert_query(self.model, objs, fields, **kwargs)
return query.get_compiler(using=using).execute_sql(return_id)
cursor.execute(sql, params)
return super(CursorDebugWrapper, self).execute(sql, params)
return self.cursor.execute(sql, params)
six.reraise(dj_exc_type, dj_exc_value, traceback)
return self.cursor.execute(sql, params)
return Database.Cursor.execute(self, query, params)
Exception Type: IntegrityError at /
Exception Value: tracking_visitor.ip_address may not be NULL
Currently, in Django 1.9, tracking causes a "RemovedInDjango110Warning: django.conf.urls.patterns() is deprecated and will be removed in Django 1.10. Update your urlpatterns to be a list of django.conf.urls.url() instances instead." warning. This can easily be fixed, changing the urls.py.
We're seeing an interesting clash between django, django-tracking2, and our API provider (tastypie).
Essentially what happens is we query our tastypie API a lot. Normally this is fine, but what it does is django will create an ephemeral Session object for the request, it never gets used by tastypie normally so it doesn't get saved to the database. However, in order for django-tracking2 to track visitors it requires a session key (i.e. saves the Session to the database).
But since our use of tastypie isn't Session based, it ends up creating a unique visitor and session object every time. This results in thousands of new objects per day (in two tables!).
I can think of a few ways to handle this:
TRACK_IGNORE_URLS works. Right now it only ignores urls from populating the Pageview table. It still creates a Visitor object even if that visitor only hits one of the ignored urls. The change would simply make tracking2 oblivious to these pages in the middleware..tracking_ignore) that, when set to False would have the middleware ignore the request.I feel like option 2 is the best but it does change the behavior of an existing setting.
The package will cause an error while using Django4+.
Django3+ works fine.
Can we add requirement file to include pytz in it .
Just an idea .
Catch these, and display as error messages on the page.
I just wanted to find out if it's possible to use this amazing python package with django rest framework...like with reactjs
The first time a Visitor is recorded, the user is not attached to the record being created.
I get template error. It can't seem to find the base.html and looks like its missing in the repo
I want to avoid tracking URLs that start with the following:
'/en/jsi18n', '/media...', 'Cache'...
How do I go about configuring this?
I did something like the one below but didn't seem to work:
TRACK_IGNORE_URLS = r'^(favicon\.ico|robots\.txt|media|Cache|/en/jsi18n/)$',
I am using django 1.6.5 for python 2.7 and did following
pip install django-tracking2
tracking to your project's INSTALLED_APPS
Add tracking.middleware.VisitorTrackingMiddleware
TRACK_AJAX_REQUESTS=True
TRACK_ANONYMOUS_USERS=True
TRACK_REFERER=True
TRACK_QUERY_STRING=True
Looks like we get error under this
def is_valid_ip_address(address_family, ip_str):
try:
socket.inet_pton(address_family, ip_str)
except socket.error:
return False
else:
return True
Team
My model got created on for the remote db but pageviews are not getting recorded. Although on local server everything is working fine
I had thought I successfully installed the package, given that I can see the information on the tracking/ page. However, when I navigate to tracking/dashboard, I get a 404 and Django tells me that it doesn't match any of the urls.
I would share code, but I'm unsure what to share which would help you understand further so please advise what you would like me to share to help solve this issue.
I'm using django 2.2.7 and installed django-tracking2 using pipenv.
Times that should display like 3:02 (3 minutes, 2 seconds) is displaying like 3:2.
Thank you for providing this app.But when I try to test it, I figure out a problem—it can’t track my account when I refresh the page while I’m already login with super-user.
Whether it ignores the super-user ?
Even though the README suggests include the urls module under the tracking/ namespace, the only endpoint that is exposed is under dashboard/ which is unnecessary. This should be moved to the root of the include.
APPEND_SLASH not working if I add tracking middleware
I propose having another view where we can see user statistics broke out by page/link. In particular, I have links for file downloads, and want to track who clicked on which links, and on what pages they spent their time.
I dont know proper way to do link visiting (outside of bit.ly or something) but it would b nice to accumulate statistics on links somehow as well as page visits by user.
I need to give the user the ability to not be tracked but can't seem to find a way to exclude them from the tracker. Is there a way to do this or should I try to modify the package to do so? If I do get it to be able to exclude users, should I submit a PR? This is a very useful package and I'd like to help improve it if I can.
Does django-tracking2 support Python 3?
If so, it would be nice to designate that on PyPI using classifiers in setup.py (see https://pypi.python.org/pypi?%3Aaction=list_classifiers)
If not, what does the path forward look like?
Was a little confused by the default state of the dashboard. Currently if you do not specify the GET params 'start' and 'end' as yyy-mm-dd formatted dates (ex: https://www.example.com/tracking/?start=2013-11-1&end=2013-11-30) the dashboard will say there are no stats to show. I think this should, at the very least default to something and maybe mention it in the README. As far as I can see the start and end params are not mentioned anywhere, I only found this by reading the source.
Lines 16 and 17 of views.py appear to be the culprit:
if not date_str:
return
This causes the model queries to return empty sets of stats.
I decided to use the upper variable to determine what date to automatically calculate since that appears how it is used elsewhere anyway.
In place of the original lines 16 and 17 I am now using:
if not date_str:
if not upper:
return date.today() - timedelta(days=7)
else:
return date.today()
The 7 days value was completely arbitrary, but you get the idea.
How to change dashboard.html style ?
Hello, I'm using a custom User model, that is linked to a profile. I got the following error while loggin in.
Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/django/core/handlers/base.py", line 199, in get_response
response = middleware_method(request, response)
File "/usr/local/lib/python2.7/dist-packages/tracking/middleware.py", line 76, in process_response
visitor.save()
File "/usr/local/lib/python2.7/dist-packages/django/db/models/base.py", line 545, in save
force_update=force_update, update_fields=update_fields)
File "/usr/local/lib/python2.7/dist-packages/django/db/models/base.py", line 573, in save_base
updated = self._save_table(raw, cls, force_insert, force_update, using, update_fields)
File "/usr/local/lib/python2.7/dist-packages/django/db/models/base.py", line 654, in _save_table
result = self._do_insert(cls._base_manager, using, fields, update_pk, raw)
File "/usr/local/lib/python2.7/dist-packages/django/db/models/base.py", line 687, in _do_insert
using=using, raw=raw)
File "/usr/local/lib/python2.7/dist-packages/django/db/models/manager.py", line 232, in _insert
return insert_query(self.model, objs, fields, **kwargs)
File "/usr/local/lib/python2.7/dist-packages/django/db/models/query.py", line 1514, in insert_query
return query.get_compiler(using=using).execute_sql(return_id)
File "/usr/local/lib/python2.7/dist-packages/django/db/models/sql/compiler.py", line 903, in execute_sql
cursor.execute(sql, params)
File "/usr/local/lib/python2.7/dist-packages/django/db/backends/util.py", line 53, in execute
return self.cursor.execute(sql, params)
File "/usr/local/lib/python2.7/dist-packages/django/db/utils.py", line 99, in __exit__
six.reraise(dj_exc_type, dj_exc_value, traceback)
File "/usr/local/lib/python2.7/dist-packages/django/db/backends/util.py", line 53, in execute
return self.cursor.execute(sql, params)
File "/usr/local/lib/python2.7/dist-packages/django/db/backends/mysql/base.py", line 124, in execute
return self.cursor.execute(query, args)
File "/usr/lib/python2.7/dist-packages/MySQLdb/cursors.py", line 174, in execute
self.errorhandler(self, exc, value)
File "/usr/lib/python2.7/dist-packages/MySQLdb/connections.py", line 36, in defaulterrorhandler
raise errorclass, errorvalue
IntegrityError: (1452, 'Cannot add or update a child row: a foreign key constraint fails (`company`.`tracking_visitor`, CONSTRAINT `user_id_refs_id_e9c7bb5d` FOREIGN KEY (`user_id`) REFERENCES `users_userprofile` (`id`))')
Thanks
This has been a source of confusion when attempting to integrate the app since it assumes the project has a base.html defined. The new approach will be to render it's own UI since it has a standalone purpose.
When visit /dashboard/,
TypeError at /dashboard/
can't subtract offset-naive and offset-aware datetimes
Request Method: GET
Request URL: http://mysite.com/dashboard/
Django Version: 1.4
Exception Type: TypeError
Exception Value:
can't subtract offset-naive and offset-aware datetimes
Exception Location: PROJECT_DIR/tracking/middleware.py in process_response, line 64
Python Executable: /usr/local/bin/python
Python Version: 2.7.3
Python Path:
['',
'/usr/local/sae/python/lib/python27.zip',
'/usr/local/sae/python/lib/python2.7',
'/usr/local/sae/python/lib/python2.7/plat-linux2',
'/usr/local/sae/python/lib/python2.7/lib-tk',
'/usr/local/sae/python/lib/python2.7/lib-old',
'/usr/local/sae/python/lib/python2.7/lib-dynload',
'/usr/local/sae/python/3rd/django1.4',
'/usr/local/sae/python/lib/python2.7/site-packages']
You should update the released package.
Currently 0.3.1 on pypi
https://pypi.python.org/pypi/django-tracking2/0.3.1
which does not include the Django 1.10 fixes from May!
Easy enough to workaround by rolling your own urls line, but might confuse people...
The latest version of the project in pypi doesn't have django 2.0 support
I understand that as per the library we can only see the total visitors and all other stats when we have access to admin using ip/tracking/ template however i am looking to use the total visitors on my page s footer
Understand you use Total {{ visitor_stats.registered.total }} as template variable in dashboard.html , is it possible in someway that i can include this in my site base.html and wll users visiting the site could see total number of visitors and other such stats ?
templates/tracking/dashboard.html extends "base.html", but wher is it?
summary/dashboard - /
visitor centric - /visitors/:id
/
/visits/:id - info about a particular visit
/pages/:key - info about a particular page (across all visits)
/pageviews/:id - info about a page for a given visit
page/URL centric - /pages
/
/:key (key could be encoded version of URL?)
/visitors/:id/pages/:keydjango 2.x ModuleNotFoundError: No module named 'django.contrib.gis.geoip'
django.contrib.gis.geoip2
Even with the best efforts to get around the possible race condition in _refresh_visitor, there still seems to be a chance for an error on Visitor.save(). In the following traceback, you can see that after the IntegrityError is caught, when Visitor.objects.get(pk=session_key) is called, the Visitor with that key no longer exists. This means either a) the IntegrityError is being raised for another reason other than the assumed clashing session keys, which I can't see how that could happen, or b) There's some weird race condition in which .save() raises an IntegrityError but when we try to get the Visitor it doesn't exist yet.
DoesNotExist: Visitor matching query does not exist.
File "django/core/handlers/base.py", line 223, in get_response
response = middleware_method(request, response)
File "newrelic/hooks/framework_django.py", line 331, in wrapper
return wrapped(*args, **kwargs)
File "tracking/middleware.py", line 141, in process_response
visitor = self._refresh_visitor(user, request, now)
File "tracking/middleware.py", line 98, in _refresh_visitor
visitor = Visitor.objects.get(pk=session_key)
File "django/db/models/manager.py", line 127, in manager_method
return getattr(self.get_queryset(), name)(*args, **kwargs)
File "django/db/models/query.py", line 334, in get
self.model._meta.object_name
middleware.py, lines 140-141
# update/create the visitor object for this request
visitor = self._refresh_visitor(user, request, now)
middleware.py, lines 90-98
try:
visitor.save()
except IntegrityError:
# there is a small chance a second response has saved this
# Visitor already and a second save() at the same time (having
# failed to UPDATE anything) will attempt to INSERT the same
# session key (pk) again causing an IntegrityError
# If this happens we'll just grab the "winner" and use that!
visitor = Visitor.objects.get(pk=session_key)
This only occurs when search bots are indexing our site. I'm pretty sure that the rapid request/response cycle combined with a race condition is causing this error.
In Django 1.5 a configurable user model was added.
The models in django-tracking2 have a foreign key to auth.User directly. In the new Django this should point to settings.AUTH_USER_MODEL, which will point to whatever class is being used as the user model in a given app.
Could you please log the HTTP method (GET, POST, etc) for the request?
That'll give good information how frequently the various ReST operations are used for an API.
To build a views-counting system,
Can anybody tell me?
In order to use with Django 1.4, new sessions now need to be saved to the database first.
Sorry for the lack of pull request to fix, but it's a fairly simple one. Simply add the following in the middleware.py:
# If it's a new session, save it to the database first (required for Django 1.4+)
if not request.session.session_key:
request.session.save()
This will be before:
session_key = request.session.session_key
I've gone through the setup step by step. However, when attempting migrations (Django 1.7), I get
django.core.exceptions.AppRegistryNotReady: Models for app 'auth' haven't been imported yet.
Any hints as to why this is happening and how to fix it? I can't make the migrations necesary (or run the dev server). Could it be related to this error in Tastypie?
Hey,
I can see both Pageviews and Visitors in the backend but I don't get anything showing up on the frontend. It just displays:
Visitors
No visitor stats available
Registered Users
No registered user stats available
Pageviews
No pageview stats available
Do you know what might be wrong? Do I need to have a certain number of visitors before stats activate? Is it deliberately skipping the superuser account from stats generation?
Sorry to be a pest,
Cheers,
Chris
Would it be possible to have the ability to view pageview counts/stats grouped by url (or partial url), assuming TRACK_PAGEVIEWS = True
For example,
Total Unique URL
1400 800 /
600 300 /about-us/
100 17 /about-us/people/
Maybe with a column or link showing the most recent visitors?
I'm willing to add the code to render the view if it's possible to do without major changes.
Hi!
The /tracking page isn't showing any data to me. I've input end dates and start dates and all i get is
Visitor tracking began on 2016-07-04 05:10:11
No matter the end date I put. I already tried to set an end date tomorrow and 5 days from now and it hasn't helped.
It seems like it's not loading the stat.html part of the page.
I apologize if it's something I'm doing wrong and thanks for the great app :)
Cheers!
Fábio
This is what the page looks like:
Problem: Dashboard empty and the following start date: Tracking began on Jul 23, 2014 @ 5:49:22 a.m. But I really started doing tracking at 9:49:22 a.m.
I did a bit of code research and found:
Visitor.objects.user_stats(None, None)
/usr/local/lib/python2.7/dist-packages/django/db/models/fields/init.py:848: RuntimeWarning: DateTimeField Visitor.start_time received a naive datetime (2014-07-23 00:00:00) while time zone support is active.
RuntimeWarning)
[]
There is a problem with the TZ support in general.
Thanks!
Why should VisitorTrackingMiddleware be before django.contrib.sessions.middleware.SessionMiddleware?
I have custom middleware that logs a user out after 1 hour. I want to run this before VisitorTrackingMiddleware otherwise it greatly overstates the time a user spends on the site.
Or is there another way to be more accurate in the time a user spends on the site?
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
Django
The Web framework for perfectionists with deadlines.
Laravel
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft
Open source projects and samples from Microsoft.
Google
Google ❤️ Open Source for everyone.
Alibaba
Alibaba Open Source for everyone
D3
Data-Driven Documents codes.
Tencent
China tencent open source team.