TOLOGIX - ISLG Maintenance

Project dealing with all ongoing maintenance of the current ISLG application (www.investorstatelawguide.com and dev.investorstatelawguide.com).

Encrypt Notepad Details

Assigned to
Anil Vaghela Anil V. Harsh Parikh, Tech Lead at DevIT Harsh P. Ryan Knuth, Customer Support Manager at Industrial Ryan K.
Due on
Notes
Further to discussion on this issue, we need to ensure that all Notepad details are secured in a separate encrypted SQL database. The priority is to secure the Notepad details concerning the bookmarks and research topics saved by individual front-end users; however, we can explore options that secure both the usages details and bookmark details. Anil Vaghela Anil and Harsh Parikh, Tech Lead at DevIT Harsh , please examine the issues and propose a recommended solution.

Comments & Events

Morgan Maguire, CEO
Hi Harsh Parikh, Tech Lead at DevIT Harsh and Anil Vaghela Anil ,

We had a meeting with a client today, and they specifically asked about the security of the data concerning the Notepad Feature. Let's ensure that this to-do is integrated into the workflow.

Thanks,

Morgan
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan and Ryan Knuth, Customer Support Manager at Industrial Ryan ,

We did some R&D regarding security of encrypted data and found that no one else can Decrypt the data. Hence, It is secure to store the data in encrypted format into database. Please suggest, If it is OK then we can start development.
Ryan Knuth, Customer Support Manager at Industrial
Thank you, Harsh Parikh, Tech Lead at DevIT Harsh . I'm OK with it being in the same database if you've confirmed it's sufficiently encrypted.

Ryan
Morgan Maguire, CEO
Hi Harsh Parikh, Tech Lead at DevIT Harsh and Ryan Knuth, Customer Support Manager at Industrial Ryan ,

I'm fine with it being on the same database as well. As long as the data is encrypted, and decrypted data is only inaccessible to the front-end user.

Also, Harsh Parikh, Tech Lead at DevIT Harsh , could you forward me some literature/documents that explain the mechanics of how this works, so that we can explain it to clients when they ask?

Thanks,

Morgan
Harsh Parikh, Tech Lead at DevIT
OK Thanks Morgan Maguire, CEO Morgan and Ryan Knuth, Customer Support Manager at Industrial Ryan .

Morgan Maguire, CEO Morgan , I will provide word document within one/two days.
Morgan Maguire, CEO
Great. Thanks Harsh Parikh, Tech Lead at DevIT Harsh .

Morgan 
Morgan Maguire, CEO
Thanks for this Harsh Parikh, Tech Lead at DevIT Harsh .

Morgan 
Morgan Maguire, CEO
Hi Harsh Parikh, Tech Lead at DevIT Harsh ,

Just confirming that we've started development on encrypting the Notepad data.

Thanks,

Morgan 
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan ,

We have started analysis how to encrypted & decrypted old notepad data in SQL database and Parallel, we are also making document as programming point of view.

We will start development very soon and will keep you updated.
Morgan Maguire, CEO
Great. Thank you for the update Harsh Parikh, Tech Lead at DevIT Harsh .

Morgan
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan ,

We have implemented the Encryption Decryption for Notepad Feature and uploaded on dev.islg. Now, the bookmark details are saved in encrypted format in dev's database.

We have also encrypted the old bookmark data on dev.islg's server.

Please check and confirm.
Morgan Maguire, CEO
Hi Harsh Parikh, Tech Lead at DevIT Harsh ,

Great. Glad to hear this is complete. However, what do you mean by "old bookmark data"? Are you referring to data that has been deleted by users (e.g., when they delete a bookmark from a research topic)? If so, we shouldn't be storing this data. When a user deletes bookmark data, it should also delete it from the server. Could you please clarify.

Also, did you ever create the document for explaining the encryption from programming point of view?

Thanks,

Morgan
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan ,

The Old data mean the data which have already stored on database. It means We have encrypted those User's bookmark data which have already saved in plain text on server.

Also, We have confirmed that when user deletes bookmark data, it is deleted from the server. We haven't stored deleted data.

Yes..We have also made document for developer point of view which explains encryption decryption algorithm.
Morgan Maguire, CEO
Hi Harsh Parikh, Tech Lead at DevIT Harsh ,

Ok. That all sounds good. Could you send me a copy of the document, so that I can keep this on file.

Also, I'd like to discuss this with Ryan Knuth, Customer Support Manager at Industrial Ryan before migrating things through to production, so we'll hold off on doing any further until he's back on July 23rd.

Thanks,

Morgan
Morgan Maguire, CEO
Great. Thank you, Harsh Parikh, Tech Lead at DevIT Harsh . I'll follow-up on next steps once I'm able to consult with Ryan Knuth, Customer Support Manager at Industrial Ryan .

Morgan 
Morgan Maguire, CEO
Hi Ryan Knuth, Customer Support Manager at Industrial Ryan ,

Just a heads up on our call tomorrow. Could you be prepared to comment on the above. I want to get sign off from you that we've done everything necessary to get all the Notepad data encrypted and secured so that we can migrate the changes through to www.islg on Monday.

Thanks,

Morgan 
Ryan Knuth, Customer Support Manager at Industrial
Hi Harsh Parikh, Tech Lead at DevIT Harsh  

For some reason I don't have the IPs for dev.islg web and SQL servers saved, only prod. Could you let me know please?

Thanks!

Ryan
Harsh Parikh, Tech Lead at DevIT
Hi Ryan Knuth, Customer Support Manager at Industrial Ryan ,

Following are the IPs of dev.islg web and SQL server

dev.islg web - 10.68.138.10
SQL Server -   10.68.138.11

Let me know you need anything else.
Ryan Knuth, Customer Support Manager at Industrial
Thanks Harsh Parikh, Tech Lead at DevIT Harsh  
Ryan Knuth, Customer Support Manager at Industrial
Hi Harsh Parikh, Tech Lead at DevIT Harsh  

We looked at the encryption and have a few questions:
  • Should we be encrypting the SubscriberID within these tables as well?
  • Will you be changing the encryption keys for production?
  • Just want to confirm that when we release this, there will be no negative functional affects on the existing notepad details? (While encrypting that existing data of course)
Thanks!

Ryan
Harsh Parikh, Tech Lead at DevIT
Hi Ryan Knuth, Customer Support Manager at Industrial Ryan ,

Following, We have mentioned the answers.

  • Should we be encrypting the SubscriberID within these tables as well?
        -  We have encrypted Type, Tile, Link Title, Link, Description fields for                   notepad feature. These fields are cover all details of Notepad data. 
             As Security point of view, we don't think so Subscriber ID is 
             necessary to encrypting Because Subscriber ID is connected with                     many reference tables and it will affect many tables to populate                         results.
  • Will you be changing the encryption keys for production?
       - Yes. We will change the encryption keys for production
  • Just want to confirm that when we release this, there will be no negative functional affects on the existing notepad details? (While encrypting that existing data of course)
     - We have checked existing notepad feature on dev.islg and There will be         no negative functional affects on the existing notepad details.
Ryan Knuth, Customer Support Manager at Industrial
Great. Thanks for all of these clarifications Harsh.

Ryan
Morgan Maguire, CEO
Hi Harsh Parikh, Tech Lead at DevIT Harsh and Ryan Knuth, Customer Support Manager at Industrial Ryan ,

Thanks for the details above. Just so I understand this correctly, we have encrypted all the details concerning the bookmarks themselves, but we have not encrypted the Subscriber ID's. Therefore, in the event of a data breach, it would possible to identify that a subscriber has created bookmarks, but it would be impossible to identify the content of those bookmarks, correct? Also, does this apply to the research topic names and descriptions, because this is sensitive information that should be encrypted as well? 

Also, does this server store a copy of the research reports that have been exported in Word? If so, these should be automatically deleted as soon as they are generated to ensure there is data risk there as well.

Finally, is it possible to apply the same encryption (and purging of automated reports) for Client/File#s, Matter#s and comments assigned to sessions through the session information window? This also has sensitive information that needs to be protected.

Thanks,

Morgan
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan ,

Following, I have mentioned the answers of your above questions.
  • Yes. It would be Impossible to identify the content of those bookmarks by using Subscriber Id.
  • We haven't stored the copy of the research reports on server. It is overwriting by every time. 
  • Yes. It is possible to apply same encryption method for Client/File#s, Matter#s and comments assigned to sessions through the session information window. We will start the analyse that how many database tables' fields will be encrypted. 
Morgan Maguire, CEO
Hi Harsh Parikh, Tech Lead at DevIT Harsh ,

Great. That satisfies my concerns regarding the bookmarks and exported research reports. However, what about the research topic names and descriptions? Can you confirm whether this information is encrypted? If not, let's ensure this is done as well.

Yes, please proceed with encrypting the Client/File#s, Matter#s and comments.

Thanks,

Morgan
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan ,

My Apologies. I forgot to mentioned answer in my previous comment.
Yes. We have already did encrypted the research topic names and descriptions on dev.islg.

Could we migrate this Encrypt/Decrypt Notepad details task on www.islg on next Tuesday ??


Morgan Maguire, CEO
Great. Thanks Harsh Parikh, Tech Lead at DevIT Harsh .

Sure. Let's migrate the Notepad Details on Tuesday. I'll schedule this to-do for that date, and then we'll do the usage details during a subsequent window.

Thanks,

Morgan 
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan and Ryan Knuth, Customer Support Manager at Industrial Ryan ,

We have migrated Notepad Details Encryption/Decryption on www.islg. We have also changed the Encryption key on production environment.

Please check and confirm.
Ryan Knuth, Customer Support Manager at Industrial
Thank you, Harsh Parikh, Tech Lead at DevIT Harsh . I've looked at islg, islg_new, and islg_data. Which one is production again? In any case I confirmed the encryption.

Ryan
Harsh Parikh, Tech Lead at DevIT
Hi Ryan Knuth, Customer Support Manager at Industrial Ryan ,

Following, I have mentioned the database details :

ISLG :-  Production Database (www.islg)
islg_data :-  Dev demo database (dev.islg)
islg_new :- Database for testing purpose.
Ryan Knuth, Customer Support Manager at Industrial
Great, thank you Harsh Parikh, Tech Lead at DevIT Harsh .
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan and Ryan Knuth, Customer Support Manager at Industrial Ryan ,

We are working to Encrypting/Decrypting the Client/File#s, Matter#s and comments.

There are so many places in application that we need to Encrypting/Decrypting the Client/File#s, Matter#s and comments.
(For Ex. Member site session information window, PDF File, Excel File, Admin site session information window etc..) Hence, It will take some time to complete. We will keep you updated.
Morgan Maguire, CEO
OK Harsh Parikh, Tech Lead at DevIT Harsh . Understood. Thanks for the update.

Morgan
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan  

Just FYI : The work is still continue and will you keep updated.
Morgan Maguire, CEO
Thanks Harsh Parikh, Tech Lead at DevIT Harsh
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan ,

FYI :-

We made changes of Encryption/ Decryption for Client/File#s, Matter#s and comments in our local environment and currently, we are testing on both Member site and admin site.

Once testing will be done we will upload the changes on dev.islg.
Morgan Maguire, CEO
Great. Glad to hear it Harsh Parikh, Tech Lead at DevIT Harsh . Thanks for the update.

Morgan 
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan and Ryan Knuth, Customer Support Manager at Industrial Ryan ,

We have implemented the Encryption Decryption alogrithm for Client/File#s, Matter#s, Comments and uploaded on dev.islg.

We have also encrypted the old data (e.g The data which  already stored on database) on dev.islg's server.

Morgan Maguire, CEO Morgan , I am suggesting you that if we will show only past 6 months data in Session Information window then it is good for speed point of view. Because currently, The Session Information window is taking some time to load all the past 12 months data.

Following, The reason of slow down to open Session Information Window.
  • Currently, We are fetching the past 12 months encrypted data          (Client, Matter, Comments) for Session Information window from database and By using algorithm, we are Decrypting each record through loop and display in session information window. 

Please Suggest.
Morgan Maguire, CEO
Hi Harsh Parikh, Tech Lead at DevIT Harsh

I see what you mean. The loading time is incredibly slow. Is there another way to encrypt the data to speed up the process? The tool was already loading data slower than I'd like, and I don't want to implement anything that will make it worse. It's very common for us to pull 12 months worth of data, which is why this is default setting. So please come up with a solution that speeds up the encryption algorithm. I would also investigate ways of speeding up the loading times of the session details page more generally. Perhaps there are ways we can get the data to load more efficiently without sacrificing what is ultimately displayed to users.

Morgan
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan ,

I understood your concern.

We are looking to find another way (e.g Directly from SQL or something else) to encrypt/decrypt the data to speed up the process. we will keep you updated for same.
Morgan Maguire, CEO
Great. Thanks Harsh Parikh, Tech Lead at DevIT Harsh . Note that it's fine if we need to expand the scope of the data that is encrypted to make it more efficient, as long as it doesn't effect the front-end user experience.

Morgan 
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan ,

We have found another method for encryption/decryption. The data will be directly decrypted by SQL query. It give us huge improvemnt for speed up.

Currently, This is on trial and error method for us. we are working on it and will update you soon.
Morgan Maguire, CEO
Great, Harsh Parikh, Tech Lead at DevIT Harsh . Glad to hear there is a possible solution. Also, if we can speed up the general loading time of the session reports in conjunction with this issue, that would be great as well.

Thanks,

Morgan 
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan ,

Yes. We can also speed up the general loading time of the session reports.
Morgan Maguire, CEO
That's great Harsh Parikh, Tech Lead at DevIT Harsh . Thanks.
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan and Ryan Knuth, Customer Support Manager at Industrial Ryan ,

We have changed the Encryption/Decryption method for Client/File#s, Matter#s and comments fields and uploaded on dev.islg.

Now, It takes hardly 5 Seconds to display 100 number of records in Session Information Window. It is also takes near about 3 seconds to generate session reports.

Please check and let us know the feedback.
Morgan Maguire, CEO
Hi Harsh Parikh, Tech Lead at DevIT Harsh ,

It looks really look. I'm happy with the speed.

Ryan Knuth, Customer Support Manager at Industrial Ryan , could you confirm, and we'll get this migrated to www.islg.

Morgan 
Morgan Maguire, CEO
Hi Ryan Knuth, Customer Support Manager at Industrial Ryan ,

Could you confirm everything looks ok on this to-do so we can get it migrated on the next window.

Thanks,

Morgan 
Ryan Knuth, Customer Support Manager at Industrial
Hi Harsh Parikh, Tech Lead at DevIT Harsh  

It looks to be functioning as expected and is much more performant, however, I discovered an error when attempting to load my Research Topics after I had edited the name of one of my saved research topics.

  1. With user islgtesting / islg4testing I saved a new research topic titled "Sept 11"
  2. I then opened the research topic "July 25"
  3. Opened the Research Topics and edited "Sept 11" to be "Sept 11 -2"
  4. When attempting to open Research Topics now I receive a server error
Harsh Parikh, Tech Lead at DevIT
Hi Ryan Knuth, Customer Support Manager at Industrial Ryan ,

Above error is related to Notepad Details Encrypted/Decrypted method which we have resolved on both dev.islg and www.islg.

Please check and confirm.
Ryan Knuth, Customer Support Manager at Industrial
Thank you, Harsh Parikh, Tech Lead at DevIT Harsh . Looks good on dev.islg.
Morgan Maguire, CEO
Looks good Harsh Parikh, Tech Lead at DevIT Harsh . Scheduling this for migration on Monday.

Morgan 
Morgan Maguire rescheduled this to-do
Was
Now
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan and Ryan Knuth, Customer Support Manager at Industrial Ryan ,

We have migrated the Client/File#s, Matter#s and comments fields Encryption/Decryption task on www.islg.

Please check and let us know the feedback.
Morgan Maguire, CEO
Hi Harsh Parikh, Tech Lead at DevIT Harsh ,

It's working well for me. I'll let Ryan Knuth, Customer Support Manager at Industrial Ryan confirm, and then we can mark this to-do complete.

Thanks,

Morgan 
Morgan Maguire, CEO
Hi Ryan Knuth, Customer Support Manager at Industrial Ryan ,

I'm not able to recreate the issue with my testing account.

Harsh Parikh, Tech Lead at DevIT Harsh , could you please try to recreate the issue to ensure this isn't affecting other users.

Thanks,

Morgan
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan and Ryan Knuth, Customer Support Manager at Industrial Ryan ,

Yesterday, After migration, We have tested the this task with different users credentials and we had forgot to clear specific Ryan's user data on www.islg.

Ryan Knuth, Customer Support Manager at Industrial Ryan , We have cleared all testing data from www.islg and issue is resolved now.

Please check and confirm.
Ryan Knuth, Customer Support Manager at Industrial
Great, thanks Harsh Parikh, Tech Lead at DevIT Harsh . Looks good on www.islg.

Ryan
Morgan Maguire, CEO
Ok. Great. I'll mark this to-do complete.

Morgan
Morgan Maguire, CEO
Morgan Maguire completed this to-do.