TOLOGIX - ISLG Maintenance

Project dealing with all ongoing maintenance of the current ISLG application (www.investorstatelawguide.com and dev.investorstatelawguide.com).

Problem with 10 second, 1 page sessions

Assigned to
Harsh Parikh, Tech Lead at DevIT Harsh P. Jitesh Dhuravala, DevIT Jitesh D. Ryan Knuth, Customer Support Manager at Industrial Ryan K.
Notes
Further to the problem we experienced previously: https://basecamp.com/2341283/projects/12196005/todos/271259648. We are starting to see accounts generate suspicious usage with 10 second, 1 page sessions (see examples below - many are the same accounts where we saw the problems appear before). Note as well that the frequency of these 10 second, 1 page sessions started occurring more frequently in September. Please ensure that the domain validations are still working, and that we're not compromising usage data going forward.

Examples of 10 second, 1 page sessions:

Comments & Events

Morgan Maguire, CEO
These are accounts where the problems is widespread:
The current validated domain URLs are the following:

| Subscriber  | Domain URLs
| Georgetown University  | georgetown.edu
| Gujarat National Law University  | gnlu.ac.in
| Peace Palace Library  | peacepalacelibrary.nl
| Universidad de San Andrés  | udesa.edu.ar/
| University of Vienna  | univie.ac.at/en/

Liam Murphy-Burke, Strategic Account Manager at ISLG Liam , could you please contact these subscribers to confirm the URLs of the proxy server used for accessing ISLG to ensure they match with how we are validating them with our system.

Thanks,

Morgan
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan ,

For account Pace Palance Library, We had validated peacepalacelibrary.nl domain URL.

Today, We have also validated the ppl.nl domain URL. so, please monitoring the session usage of Pace Palance Library acount and let us know the feedback.
Morgan Maguire, CEO
Hi Harsh Parikh, Tech Lead at DevIT Harsh ,

Thank you for adding the additional URL for the Peace Palace Library account. We will monitor usage, and let you know if there is any change.

In the meantime, is there anything we can do to test the validation system to ensure it is working properly, because the issue appears to be widespread across multiple accounts where there is no ambiguity about the domain URLs?

Thanks,

Morgan
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan ,

Do you check the session usage of the Peace Palace Library account ?

We are not able to test the Proxy URLs session usage directly from our environment. We also don't have any login credentials in our local environment. we need remote session to check the issue.

Please suggest.
Morgan Maguire, CEO
Hi Harsh Parikh, Tech Lead at DevIT Harsh ​,

Below is the latest usage report from the Peace Palace account, which appears to have normalized somewhat. However, I'm still concerned about the usage for all other accounts above.

How do you suggest we resolve the problem.


Thanks,

Morgan
Harsh Parikh, Tech Lead at DevIT
Hello Morgan Maguire, CEO Morgan  ,

It seems that the problem is because of multiple URLs are used by users which are not validated by our system. Hence, it would be great if we can confirm with the above universities whether they are using other URLs too which are not registered in our system. If problem persists then we might need user credentials or need to take remote session of their environment to figure out the issue.
Morgan Maguire, CEO
Ok Harsh Parikh, Tech Lead at DevIT Harsh .

We'll confirm whether other domain URLs are necessary for the accounts above, and if that doesn't resolve the problem we'll setup sessions with the users.

Liam Murphy-Burke, Strategic Account Manager at ISLG Liam , please ensure we get these domain URLs for the above accounts confirmed ASAP.

Thanks,

Morgan
Liam Murphy-Burke, Strategic Account Manager at ISLG
Hi Morgan, 

I sent out an email last week about this, I didn't hear back from any of the 5 you requested however.  I will send followups today.

Liam
Morgan Maguire, CEO
Ok, Liam Murphy-Burke, Strategic Account Manager at ISLG Liam . Please call them if necessary. We need to confirm this as soon as possible.

Morgan
Morgan Maguire, CEO
Hello Harsh Parikh, Tech Lead at DevIT Harsh ,

Georgetown University provided us with the following URL for their EzProxy server: http://proxygt-law.wrlc.org/. How do you suggest we use this to validate the appropriate domaine URLs. Should we just use wrlc.org to ensure we cover any proxy server accessing the system via Washington Research Library Consortium proxy server? Perhaps you could explain a little more how this validation system works, so that we can ensure we're providing you with the appropriate information.

Thanks,

Morgan
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan ,

We have checked Georgetown University's Proxy URL in our database and it was georgetown.edu which is totally different from above Proxy URL.so, We have also validated above Proxy URLs (wrlc.org) in our database.

Yes. We can ensure that we cover any proxy server accessing by validating the wrlc.org

We have stored all Proxy URLs in one table in our database. If Our database Proxy URLs will match the contains with entered Proxy URLs then it will be validated.

For Georgetown University case, Our Database Proxy URL is georgetown.edu. Hence, it was not validated with Proxy URL http://proxygt-law.wrlc.org/.
Morgan Maguire, CEO
Hi Harsh Parikh, Tech Lead at DevIT Harsh ,

Attached is an updated list of proxy URLs. New URLs are highlighted in green. Please make the appropriate updates, and we'll continue to collect the additional URLs from the other clients. Note that I've added the wrlc.org URL to all the schools that are members of that consortium.

We'll continue to monitor these accounts with updated URLs, and see if this fixes the problem.

Thanks,

Morgan

 
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan ,

We have added and Validated green Marked Proxy URLs in our www.islg database.
Morgan Maguire, CEO
Great. Thanks Harsh Parikh, Tech Lead at DevIT Harsh .

I'll continue to monitor usage to see if there is improvement. So far the accounts for the Peace Palace Library and Georgetown University appear to have normalized.

Liam Murphy-Burke, Strategic Account Manager at ISLG Liam , please ensure you follow-up with clients that have not got back to you yet.

Thanks,

Morgan 
Morgan Maguire, CEO
Morgan Maguire completed this to-do.
Morgan Maguire, CEO
Morgan Maguire re-opened this to-do.
Morgan Maguire, CEO
Hi Jitesh Dhuravala, DevIT Jitesh and Harsh Parikh, Tech Lead at DevIT Harsh ,

I've reactivated this to-do, because we have some accounts that have been showing persistent anomalous usage the last few months, and I'd like to get it resolved. The accounts with problems are the following:
All of these account are showing large volumes of anomalous usage (i.e., sessions with 10 second of duration and 1 page view).  All of these accounts have the following domains validated:
  • Peace Palace Library  | peacepalacelibrary.nl  | ppl.nl  | peacepalace.idm.oclc.org
  • Renmin University of China  | ruc.edu.cn
  • Universidad de San Andrés  | udesa.edu.ar/  | login.eza.udesa.edu.ar 
  • University of Vienna  | univie.ac.at/en/
  • West Bengal National University of Juridical Sciences  | nujs.edu


However, this hasn't resolved the problem. Is there anything further we can do to resolve this issue on these accounts?

Thanks,

Morgan
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan ,

We have tried to reproduce the above issue in our local environment with using above accounts IP address but it is working fine.

We have again validate above accounts with common word on www.islg
(for ex. If proxy URL is nujs.edu then we have checked word nujs and if word will be found then it will be valid.)

Hence, Please monitor above URLs for 2 to 3 days and still problem is running then we need to take remote session any of above account to find out the root of this problem.

Please Suggest.
Morgan Maguire, CEO
Sounds good Harsh Parikh, Tech Lead at DevIT Harsh . We'll monitor usage over the next couple of days, and see what the results are.

Morgan 
Morgan Maguire, CEO
Hi Harsh Parikh, Tech Lead at DevIT Harsh ,

I've reviewed the usage on the accounts above, and here are the results:
Therefore, things have improved, but the usage on Renmin University of China account is concerning. Can you please take a closer look at this account, perhaps we need to broaden the validation of the domain URL to anything with "ruc.edu"

Thanks,

Morgan
 
Harsh Parikh, Tech Lead at DevIT
Ok Thanks Morgan Maguire, CEO Morgan .

For Renmin University of China, I have updated Proxy URL with only "ruc". Hence, any of URL they used, If it contains "ruc" in URL then it will be validated.

Please monitor this account for 2 to 3 days.
Morgan Maguire, CEO
OK. Thanks Harsh Parikh, Tech Lead at DevIT Harsh . I'll continue to monitor things over the next few days.

In the meantime, Marysia Raptis Marysia , could you please contact the subscriber, and ensure we've been given accurate IP address ranges for this accounts, because the problem only seemed to start in the last few weeks.
 
Morgan 
Morgan Maguire, CEO
Hi Liam Murphy-Burke, Strategic Account Manager at ISLG Liam and Marysia Raptis Marysia ,

Further to the comments above, there is a problem with significant anomalous usage on the Renmin University account: https://www.investorstatelawguide.com/subscribers/ShowGroupSession. Over the past few weeks there have been thousands of sessions from hundreds of different IP address ranges. This is very suspicious usage, so I have deactivated their accounts (their account expired today as well).

Assuming they decide to renew their account, we will need them to confirm their IP address ranges, and ensure that this only granting access to legitimate users from the University. The starting point is to establish direct contact with someone at the University. Looking through the correspondence, I don't see a record of any direct contact with someone at Renmin University. All correspondence has been with a subscription agent at  CEPIEC (China Educational Publications Import & Export Corporation). In fact, looking at the SA signed last April, it appears it was signed by someone at CEPIEC, rather than by someone at Remnin University.



This is unacceptable. It needs to signed by someone at the University. Let's ensure all these issues get resolved before the account gets reactivated, and ensure that we are addressing these issues with other subscribers that were setup through a subscription agent (particularly in China).

Thanks,

Morgan 

   
Marysia Raptis
Will look into this.

Marysia
Morgan Maguire, CEO
Hello all,

With the exception of the Renmin University and West Bengal National University accounts, which were deactivated for other reasons, the usage for the other accounts appears to have normalized, so I'll close this to-do again for the time being.

Thanks,

Morgan
Morgan Maguire, CEO
Morgan Maguire completed this to-do.