TOLOGIX - ISLG Maintenance

Project dealing with all ongoing maintenance of the current ISLG application (www.investorstatelawguide.com and dev.investorstatelawguide.com).

Errors in duration of sessions

Assigned to
Anil Vaghela Anil V. Harsh Parikh, Tech Lead at DevIT Harsh P.
Due on
Notes
Further to the video below, we have discovered that the new site is not properly recording the duration of sessions on the site. We are seeing extremely long sessions recorded, and we suspect it is because the system is not closing a session at the appropriate time. To confirm, the following actions should end a session:
  • User manually ends the session by selecting "member logout";
  • User closes the browser tab;
  • User closes the browser window; or
  • User is inactive on the site for 30 minutes.
Please confirm that all these actions are ending session for both auto-IP and user/pass accounts. It is critical that we immediately resolve the issue on dev.islg and migrate the fix to www.islg by Monday.


Comments & Events

Morgan Maguire, CEO
Hi Anil Vaghela Anil and Harsh Parikh, Tech Lead at DevIT Harsh ,

Further to the requirements above, please ensure this issue is resolved immediately, and that the fix is ready for production on Monday. We cannot afford to allow this issue to continue for any length of time. I appreciate your immediate attention to the issue.

I will make myself available over the weekend for any testing that may be necessary.

Thanks,

Morgan 
Morgan Maguire, CEO
Hi Anil Vaghela Anil and Harsh Parikh, Tech Lead at DevIT Harsh ,

We have confirmed that the 30 minutes auto-logout is not working. Therefore, if a person keeps the browser window open, the session will continue indefinitely. Please ensure this (and the other potential logout issues) is resolved ASAP.

Morgan 
Morgan Maguire, CEO
Anil Vaghela Anil and Harsh Parikh, Tech Lead at DevIT Harsh ,

Here are two more videos with more details on the problem:

This video provides detail on the 30 minute of inactivity issue:



This video provides detail on how the pages are not getting tracked when opening different links within a research tool:


As a result, it appears our session tracking problems are two-fold: (1) we are over reporting the duration of sessions, because sessions are not ending after 30 minutes of inactivity (and possibly by other actions as well), and (2) we are under reporting the number of pages viewed during a session, because the system is not recording pages when viewed within the same research tool.

How did this happen!?

Morgan
Anil Vaghela
Hello Morgan Maguire, CEO Morgan ,

We have resolved and uploaded 30 minutes logout issue on www.islg as well as dev.islg. This issue was because of a script conflict due to new design integration. We have tested all 4 scenarios you mentioned above and it works fine. Can you please test once and confirm?

Regarding page count issue: We investigated this issue and found that this functionality was not working in Subject Navigator and Article Citator since long which we have resolved and uploaded on dev.islg. This is working fine in all other tools. 

Actually our assumption regarding this functionality was different. We were assuming that the page count only increase when we navigate from one tool (page) to another tool. Can you please test this functionality on dev.islg and confirm so that we can transfer this to live on Monday.
Morgan Maguire, CEO
Hi Anil Vaghela Anil ,

Thank you for dealing wit this promptly. I'll confirm the fix later today. Yes, after analyzing usage of a few accounts over the last few years, I suspect the page count issue has gone undetected for some time.

Morgan
Morgan Maguire, CEO
Hi Anil Vaghela Anil ,

I just ran a test, and I'm not seeing any change on dev.islg. The 30 minutes logout never occured, and I'm still not seeing page counts when navigating within a research tool like the Subject Navigator. Are you sure the fix was deployed?

Thanks,

Morgan 
Morgan Maguire, CEO
H Anil Vaghela Anil ,

I performed some further tests after clearing my cache, and it appears the the 30 second inactivity logout may be working now, but I'll perform further tests throughout the day to confirm.

For the page count, I'm getting different results depending on whether I'm logging in through the auto-IP and user/pass. For auto-IP, the system is still not recording pages within a tool (e.g., Subject Navigator). For user/pass it is recording the appropriate pages in the usage report, but the number of pages is not displaying in the Notepad toolbar on the front-end (see screenshots below):


 
Morgan Maguire, CEO
After further testing, I can confirm that the auto-logout after 30 minutes of inactivity is working on dev.islg for auto-IP and user/pass (both with Notepad activated and without). However, Anil Vaghela Anil , could you please clarify what qualifies as inactivity. For example, if the user has the browser tab open in ISLG, but is browsing in other tabs within the same browser window, will this be recorded as inactivity within the ISLG browser tab? My understanding of inactivity is that the 30 minute timer would start as soon as the user stops engaging with the application and is idle on the page (i.e., stops scrolling up/down the page).

Also, I've confirmed that the page count within the same research tool is not working unless accessing the system with the Notepad feature (notwithstanding the issue concerning the # of pages displayed in the toolbar outlined in the comment above). The page count is not working if accessing the system via auto-IP or user/pass without Notepad. Please ensure this is resolve for migration on Monday.

Thanks,

Morgan
Anil Vaghela
Hi Morgan Maguire, CEO Morgan ,

If the user has the browser tab open in ISLG, but is browsing in other tabs within the same browser window, will this be recorded as inactivity within the ISLG browser tab? : 
Since user has just kept ISLG opened in browser tab but not doing any activity and browsing something else in other tab of same browser the ISLG session will be expired after 30 minutes. 
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan ,

The page count in same research tool and the page count via 
auto-IP or user/pass  without Notepad issues have resolved and uploaded on both dev.islg and www.islg.

Please check and let us know the feedback.
Ryan Knuth, Customer Support Manager at Industrial
Hi Harsh Parikh, Tech Lead at DevIT Harsh

I've done some testing on both the timeout and session page count issues, and the appear to be working properly now in www.islg.

Morgan Maguire, CEO Morgan please run through your test cases again when available.

Thanks!

Ryan
Morgan Maguire, CEO
Hi Ryan Knuth, Customer Support Manager at Industrial Ryan , Anil Vaghela Anil and Harsh Parikh, Tech Lead at DevIT Harsh ,

I ran some preliminary tests, and the timeout and session page count issues appear to be resolved on both dev.islg and www.islg. I am going to perform further tests throughout the day to ensure other aspects of the session tracking are performing as expected, and will confirm again later today.

Thank you for getting this resolved on short notice over the weekend. Now we have to deal with the data hole this problem has left us. Any suggested solutions would be appreciated. 

Also, Anil Vaghela Anil , thank you for providing detail on the browser tab issue, but could you provide a more detailed explanation on exactly how the application monitors for user activity. We need to be absolutely sure that the application requirements match user expectations.

Thanks,

Morgan
Morgan Maguire, CEO
Anil Vaghela Anil , in addition to the comment above, is it possible to pinpoint when the timeout and page count issues began? That way we can at least identify the periods where the data is flawed.

Morgan 
Morgan Maguire, CEO
Hi Anil Vaghela Anil and Harsh Parikh, Tech Lead at DevIT Harsh ,

I did further testing on the system, and everything seems to working well except for an issue when closing browser tabs. Further to the video below, the systems is not differentiating sessions when the user ends a session by closing a browser tab, and then enters ISLG again through a different tab in the same browser window. It's important to note that the issue did not occur when accessing the system via user/pass with the Notepad activated, but occurred through both auto-IP and user/pass when the Notepad was not activated. Please ensure the issue is resolved (in addition to answering my questions above and providing more detail on how we monitor user activity).

Thanks,

Morgan

Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan ,

We are looking into above issue and will update you soon.
Morgan Maguire, CEO
Ok. Thank you Harsh Parikh, Tech Lead at DevIT Harsh .  
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan and Ryan Knuth, Customer Support Manager at Industrial Ryan ,

Above issue regarding session timing with both auto-IP and user/pass when the Notepad is not activated has resolved on dev.islg.

We have checked all scenarios of session timing and page count and it works fine.

Please check and let us know your feedback.

Note: Please clear your cookie/cache before perform testing.
Anil Vaghela
Hi Morgan Maguire, CEO Morgan ,

How the application monitors for user activity ?

Once user logged in, the application logs user's session time at every five seconds into the SQL database.
If user will be logged out, the logging session function will be stopped to log user's time.

The logging session function to log session time will be stopped in any of the following cases: 
  1. If user will close the browser tab or browser window 
  2. If user surfs another website from the same tab where ISLG application is running
If user will type ISLG URL in browser tab after performing any of above scenarios (1 or 2), new session will be started.

Please let me know if you need any further detail.
Ryan Knuth, Customer Support Manager at Industrial
Thank you, Harsh Parikh, Tech Lead at DevIT Harsh . I've performed some preliminary test cases and the sessions are ending as expected now.

Ryan
Morgan Maguire, CEO
Hi Anil Vaghela Anil ,

Thank you for the additional details, but I'm interested in what specific actions are necessary on a page to maintain activity and reset the 30 minute timeout. For example, is it measured as activity if the user has the browser tab open on the screen, and is scrolling up and down the page without selecting any links? Is it measured as activity if the user has the browser tab open with the cursor hovered on the page, but isn't moving the cursor? We need to understand the specific details on how the systems monitors activity to ensure it matches our requirements.

Thanks,

Morgan
Anil Vaghela
Hi Morgan Maguire, CEO Morgan ,

The session will be continue and will not be expired if user is scrolling page up and down without selecting any link.

The session will also be continue if user hovered on page only.
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan ,

We have resolved the IP access issue on dev.islg, which is described in the first video.

For second issue, It is necessary to move the user to login page. If we directly move the user on existing page then session time will continue instead of creating new session.

Please suggest.
Ryan Knuth, Customer Support Manager at Industrial
Thank you Harsh Parikh, Tech Lead at DevIT Harsh . I've confirmed the IP access is fixed on dev.islg.

For the redirect to the login page, how did we handle this previously? Or was this a reason why sessions weren't ended properly?

Ryan
Morgan Maguire, CEO
Hi Harsh Parikh, Tech Lead at DevIT Harsh ,

I've confirmed the initial problem with IP access is fixed on dev.islg as well.

However, we will need to come up with a solution that allows IP users to go directly to a member page URL without hitting a login page. The current setup would eliminate the ability for IP users to directly link to the relevant pages from Research Report (see example below), and also compromise our system of linking IP users directly to content through our newsletter: https://mailchi.mp/1c89a0939e1e/investor-state-lawguide-islg-updates-vol-6-no-990305?e=[UNIQID].

We need to come up with a solution for IP users that maintains their direct access to members pages, but eliminates the sessions problem described above. If we're able to track when a user closes a tab to pause the duration counter, shouldn't we able to differentiate when the user returns to the site through a different tab to start a new session?

Thanks,

Morgan

Morgan Maguire, CEO
Hi Anil Vaghela Anil ,

Thanks for additional details on the activity tracking. Is this tracking capability (scrolling/cursor hover) dependent on the type of browser being used to view the page, or is it the same regardless of the browser? Also, I'm wondering how it works on a mobile device.

Thanks,

Morgan
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan ,

We did some fundamental changes to resolved the IP access problem and uploaded on dev.islg. 

It means session will be stopped, if user move to another tab or browse the another site through same tab. After that, If user again returns to the ISLG site via IP access then users will be able to directly go to a member page URL without hitting a login page and also system will create new session instead of continuing with existing session.

Please check and let us know the feedback.
Ryan Knuth, Customer Support Manager at Industrial
Hi all,

I seem to be having issues with auto-IP access today. I've cleared my cache and cookies before this test as well. So far I've only tested in Chrome on Mac, but will take a look in other browsers as well.

See video:
Ryan Knuth, Customer Support Manager at Industrial
Follow up: I've been able to reproduce this in other browsers on my computer, but when testing in Windows or another Apple VM I no longer see the issue.

Morgan Maguire, CEO Morgan could you please take a look on your computer to see? I'm wondering if it's just something with my computer.

Ryan
Harsh Parikh, Tech Lead at DevIT
Hello Ryan Knuth, Customer Support Manager at Industrial Ryan and Morgan Maguire, CEO Morgan ,

Looks like there is some issue with this implementation and therefore we have reverted the last changes on dev.islg. We will look into this and re-upload the new changes again.
Ryan Knuth, Customer Support Manager at Industrial
Thank you for the clarification Harsh Parikh, Tech Lead at DevIT Harsh .
Harsh Parikh, Tech Lead at DevIT
Hi Ryan Knuth, Customer Support Manager at Industrial Ryan and Morgan Maguire, CEO Morgan ,

We have resolved the implementation issue and again re-uploaded the above changes on dev.islg.

Please check and let us know the feedback.
Morgan Maguire, CEO
Hi Harsh Parikh, Tech Lead at DevIT Harsh ,

Further to the video, I'm experiencing the following issues:
  • ending session by closing browser tab, and then re-entering members site through additional tab in same browser window successfully ends first session and creates new session; however, subsequent browsing doesn't get tracked in the session details; and
  • after performing the above, closing browser window, opening new browser window and navigating to same members page, causes IP user to be redirected to user/pass login page.
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan ,

Above both issue of closing browser tab and closing browser window with IP access have resolved on dev.islg.

Please check and let us know the feedback.
Ryan Knuth, Customer Support Manager at Industrial
Hi Harsh Parikh, Tech Lead at DevIT Harsh

This appears to be resolved for me on dev.islg, however I'd like Morgan Maguire, CEO Morgan to confirm on his system as well.

Thanks!

Ryan
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan ,

The above issue with browser closing with IP access has resolved on dev.islg.

Please check and confirm.
Ryan Knuth, Customer Support Manager at Industrial
Thank you Harsh Parikh, Tech Lead at DevIT Harsh . I've reproduced Morgan's test case above, and sessions appear to be tracking properly now in the case of closing and reopening the browser.

Ryan
Morgan Maguire, CEO
Hi Harsh Parikh, Tech Lead at DevIT Harsh and Ryan Knuth, Customer Support Manager at Industrial Ryan ,

Further to my video below, the tests proved successful after I waited a certain period of time before re-entering the members site through the new browser tab. However, the previous session continued if I immediately re-entered the site in the new browser tab. I'm fine with this result as long as the time frame is short (under 30 seconds). Harsh Parikh, Tech Lead at DevIT Harsh , could you please confirm length of time the system needs between when the initial browser tab is closed and when the user can enter the site again through the new tab to recognize it as a new session?

Thanks,

Morgan

 
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan ,

We have set the 30 second time for initial browser tab is closed and when the user can enter the site again through the new tab. After the 30 second, if user enter through new tab then new session will be started.
Morgan Maguire, CEO
Hi Harsh Parikh, Tech Lead at DevIT Harsh ,

Great. I've completed my testing on dev.islg, and everything is working as required. I'll schedule this for migration to www.islg on Monday.

Also, a final question, can I safely assume that the changes you've made to the IP access system will not jeopardize the fixes we put in place to deal with the proxy server issues? For example, I assume the list of validated domain URLs will carry through under this new system, and we will not see any further issues along these line? Please confirm to ensure we don't open up that hornets nest again.

Thanks,

Morgan
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan ,

We have tested this feature with dev.islg. Ryan Knuth, Customer Support Manager at Industrial Ryan please suggest if we can have a proxy URL for dev.islg so that we can test in proxy URL too.

Please let us know if we can upload this on live before testing this with Proxy URL.
Morgan Maguire, CEO
Hi Harsh Parikh, Tech Lead at DevIT Harsh ,

I think we should hold off on migrating this through to www.islg until we've confirmed that the proxy URL issue is not going to be a problem.

Ryan Knuth, Customer Support Manager at Industrial Ryan , could you perform the necessary testing next week, and then we'll migrate through the changes the following Monday.

Thanks,

Morgan 
Morgan Maguire, CEO
Hi Ryan Knuth, Customer Support Manager at Industrial Ryan ,

Just confirming that we'll get these tests complete, so that we can schedule this for the next migration window.

Thanks,

Morgan
Ryan Knuth, Customer Support Manager at Industrial
Hi Morgan Maguire, CEO Morgan  

I've been having some issues trying to get our test proxy server up and running again. I've asked some of our developers to give me a hand.

Thanks!

Ryan
Morgan Maguire, CEO
Ok. Sounds good Ryan Knuth, Customer Support Manager at Industrial Ryan . Let's get this completed this week, so that we can migrate this during the next release.

Thanks,

Morgan 
Ryan Knuth, Customer Support Manager at Industrial
Hi Morgan Maguire, CEO Morgan  

An update on testing with a proxy. We got our internal server running again, but the key is expired, so I'm just awaiting a new key from EZproxy for a trial.

Ryan
Morgan Maguire, CEO
OK. Sounds good Ryan Knuth, Customer Support Manager at Industrial Ryan . Let me know if they don't get back to you by tomorrow, and I'll give them a call.

Morgan 
Ryan Knuth, Customer Support Manager at Industrial
Hi Morgan Maguire, CEO Morgan  

I haven't heard back from OCLC yet about the trial license. Let me know if you can still give them a call. I registered under my email address rknuth@industrialagency.ca.

Thanks!

Ryan
Morgan Maguire, CEO
Hi Ryan Knuth, Customer Support Manager at Industrial Ryan ,

I wasn't able to get through to anyone directly on the phone, but I was given an email for a group that is dedicating to publishers' support. I cc'd you on the email, and hopefully they get back to us soon. Note that I requested that they just reactivate our previous license.

Thanks,

Morgan 
Ryan Knuth, Customer Support Manager at Industrial
Hi Morgan Maguire, CEO Morgan

I have the proxy server running again with the extended trial key.

I've done some sanity testing for the sessions and it seems to be working well. I'd like you and your team to do some extra testing as well.

You can log into the proxy server at

http://ezproxy.ind.ninja

Test user
U: testuser
P: proxytesting

Thanks!

Ryan
Morgan Maguire, CEO
Hi Ryan Knuth, Customer Support Manager at Industrial Ryan ,

How do I identify the IP address for the proxy so that I can test the IP access?

Morgan 
Morgan Maguire, CEO
Never mind Ryan Knuth, Customer Support Manager at Industrial Ryan . I was able to get from the usage reports.

Morgan 
Morgan Maguire, CEO
Hi Ryan Knuth, Customer Support Manager at Industrial Ryan and Harsh Parikh, Tech Lead at DevIT Harsh ,

I've run my tests, and everything appears to be working well through the proxy server. I'll schedule this for migration to www.islg on Monday.

Thanks,

Morgan 
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan and Ryan Knuth, Customer Support Manager at Industrial Ryan ,

We have migrated this task on www.islg. Please check and confirm.
Ryan Knuth, Customer Support Manager at Industrial
Thank you, Harsh Parikh, Tech Lead at DevIT Harsh . At first glance it looks good. Morgan Maguire, CEO Morgan if you have some time to test some as well that would be great.

Ryan
Morgan Maguire, CEO
Looks good on www.islg. We'll continue to monitor for any problems with the proxy server access; however, I'll mark the to-do complete.

Thanks,

Morgan
Morgan Maguire, CEO
Morgan Maguire completed this to-do.