Hello everyone,

As discussed during our meeting this morning, please use this to-do list to pose any questions or issues related to the migration.

I have posted a copy of the migration plan in Google Sheets (see link above). You will see that I added two more steps highlighted in yellow.

Ketan , when possible could you please fill-in all the start and end dates for steps 5 through 10.

Also, at what step do we plan on dealing with the issue related to broken tags that may exist within the new application after the Subject Navigator and Citator data is migrated? There was an extensive discussion of this issue earlier this year: Re: Tasks and Analysis Data - TOLOGIX - ISLG App Rebuild

Thanks,

Morgan

Hi Harsh ,

Following up on the plan above, are we still on track to perform step 2 of the migration plan on Monday, November 30th: Pull databases from www.islg and rebuild.islg from carbon 60 server?

Please confirm that exact date when this step will be performed so that we can coordinate on our end. Note that this includes stopping all work on http://rebuild.investorstatelawguide.com/ and preparing the offline spreadsheets (UIN Master List and Article Citator Master List).

Thanks,

Morgan

Hi Morgan ,

We are one week delay on this part due to some health and family issues of team member. We are planning to start by next week once we complete the FTS module.

Will discuss more in today's call.

Hi Harsh ,

Following-up on above, have you confirmed a date for pulling the data for the migration?

Thanks,

Morgan

Hi Morgan ,

We have taken call today with Radomir for FTS module PDF data and 90% work is completed only the Paging of Paragraph issue is pending which industrial team looking into that issue (Re: ISLG Admin Side sassquatch.min.js - TOLOGIX - ISLG App Rebuild).

We are planning to pull the Current Live ISLG database and rebuild.islg database on this Friday morning (4th December).

Also, Please send all master data spreadsheet in this thread. We can start migration process probably next Monday.

Hi Harsh ,

Ok. Thanks for confirming. Based on the December 4th data pull date, we'll proceed as follows:

Please let me know if there are any questions or concerns with the steps above.

Thanks,

Morgan

Hi Morgan ,

We will be considering updated Miscellaneous list from following sheet Dropdown Option Tab.

https://docs.google.com/spreadsheets/d/1Ho_yBR8gfCIqivmvkPy_hISkDGozdWsXxn46ImeQ-V4/edit#gid=1780667146

Hope this is fine. Please confirm.

Hi Harsh ,

Following-up on our call today, I reviewed all the Miscellaneous Lists in rebuild.islg: http://rebuild.investorstatelawguide.com/Admin/Miscellaneous/Index. With the exception of the two lists described below, all lists can be maintained and do not require updating in the migration (i.e., values in list will not be changed).

Two lists will require their values updated with data pulled from the Article Citator Master List:

1. Dispute: City:

image.png 60 KB • Download

Further to the ISLG Data Migration Map: https://docs.google.com/spreadsheets/d/1Ho_yBR8gfCIqivmvkPy_hISkDGozdWsXxn46ImeQ-V4/edit#gid=1780667146

image.png 136 KB • Download

values for this list will need to be updated with the data pulled from the Article Citator Master List:

image.png 886 KB • Download

2. Dispute: Claimant(s)

image.png 105 KB • Download

Further to the ISLG Data Migration Map: https://docs.google.com/spreadsheets/d/1Ho_yBR8gfCIqivmvkPy_hISkDGozdWsXxn46ImeQ-V4/edit#gid=1780667146

image.png 156 KB • Download

values for this list will need to be updated with the data pulled from the Article Citator Master List:

image.png 931 KB • Download

Thanks,

Morgan

Hi Harsh ,

Here are the updated master lists required for migration:

ISLG - Article Citator Master (3-Dec-20).xlsm 7.34 MB • Download

UIN Master List (3-Dec-20).xlsx 6.19 MB • Download

Please let us know if you encounter any issues with the data.

Thanks,

Morgan

Thanks Morgan .

Today, We are going to pull following things for migration.

1) Current Existing Live ISLG application database (www.islg)
2) Rebuild Database (rebuild.islg)
3) All XML agreements

All the PDFs and converted HTMLs will provide by Jitesh and DC team.

Hi Morgan ,

As per our Migration Plan, Following I have mentioned the steps which we are going to follow.

1.  Pulling database from Carbon60 Server to our local environment
2.  The Miscellaneous List and Meta Filed Management data remain as it is and we can not touch those data (Except 2 Miscellaneous list which mentioned above)
3. We clean up all Master data (Except Legal Analytics Data)
4. Again, We migrated all Masters same as previously we did in June month.
5. We associated relevant DisputeIds to Legal data so legal Analytics data will be associated properly.
6. We associated Relevant Dispute Document Id to Legal Analytics Data.
7.  Migrate the SN and TP Master Data.
8. Migrate the all Provision Master Data.
9. Migrate all the research tool data (Article Citator, Jurisprudence Citator, Publication, Term & Phrase and Subject Navigator)
10. Migrate all User/Group Data.
11.  Migrate all PDFs and Converted HTMLs in to database and application Folder.

Let me know if you have any query.

     

Hi Harsh ,

The steps above look good. However, there are two major issues that I want to ensure are covered in the above steps.

1. Resolve broken tags: as discussed in previous meetings and here: Re: Tasks and Analysis Data - TOLOGIX - ISLG App Rebuild, there is a risk that research tool data will not be compatible with some converted HTML documents (e.g., references to paragraphs do not line-up with paragraph tags in the HTML). In which of the steps below are you planning to identify and resolve any broken tags?

2. Syncing user data: as discussed in previous meetings and here: Re: ISLG Data Migration Map - TOLOGIX - ISLG App Rebuild, user/group data needs to be synced between the legacy and new applications. During previous discussions, we discussed achieving this as follows:

Could you please confirm if the requirements on this process have been finalized? Also, assuming user/groups will need to be managed in the new application after the migration is performed, at what point will management of users/groups in the legacy application cease and management in the new application start?

Thanks,

Morgan

Hi Morgan ,

For Organization Master, The Following UIN have doesn't any data in ISLG Article Sheet (Name, Type, Country).

LF/1028/6587

 We are not going to take above UIN for migration.

Hi Harsh ,

Yes, this appears to be an orphaned Organization UIN, so there is no need to upload it as part of the migration. It appears at the bottom of the Law Firms tab without any other information, and it's not referenced elsewhere in the master list:

image.png 109 KB • Download

Nafiseh and Paul , assuming there isn't something else happening here, this should be removed from the Article Citator Master List.

Thanks,

Morgan

Hi Morgan :

Yes, you're right. The last entry LF/0128/6587 has been removed from the Article Citator Master List. 

Thanks,

Paul

Perfect. Thanks Paul ​.

Morgan

Hi Harsh and Ketan ,

Further to the steps above: Re: ISLG Migration Questions - TOLOGIX - ISLG App Rebuild, could you please confirm whether the data has been pulled from the exiting ISLG application and that we can resume using and adding data to the www.islg application.

Also, further to my other comments above: Re: ISLG Migration Questions - TOLOGIX - ISLG App Rebuild, could you please confirm how these issues are going to be resolved.

Thanks,

Morgan

Hi Morgan ,

Yes, We have pulled existing www.islg database. We will migrate data till 3th December.

Hi Morgan ,

1) Resolved Broken Tags :  Once we migrated all data, PDFs and HTMLs in to new application then will get better idea to how to deal with the broken tags. Currently, We are focusing on migrate all data in to new application. We will update you once data migration will be completed.

2) Syncing user data:  The same thing for syncing user data. once all user/group data will be migrated then will make trigger or SQL job then will pull user/group data from old islg and insert in to new application. We will start work once data migration process is completed.

Ok. Harsh ​.

We'll resume working on www.islg, now that you've completed pulling the data.

I think we need to work through the syncing of user data a little more. I need you to work through and explain how you're going to avoid incongruency in the data between the old and new applications between when the data is migrated and the application is launched.

Thanks,

Morgan

Hi Morgan and Paul ,

Following 3 People's UIN 's associated Organization are not find in Law_Firm tab for Organization data. Hence, We are not able to add organization for following people UIN for People Master.

LY/3681/1851 (The Organization have name not UIN)
LY/2181/9858 (Not Find in Law_Firm tab)
LY/5212/4607 (Not Find in Law_Firm tab)

Also, Following 2 people UIN's Nationality are associated with Greece country. But, Our Country Master doesn't have Greece country. 

Can we add Greece country in our country master and associated with following 2 people.

AR/367/3573
AR/456/2388

Please confirm.

Hi Harsh :

The following Law Firm UINs should be used for the three people you identified:
- LY/3681/1851: LF/139/2340;
- LY/2181/9858: LF/172/7334; and
- LY/5212/4607: LF/1357/4074.

As far as Greece is concerned, we've used "Hellenic Republic (Greece)" with "GR" in our country master list. I've changed "Greece" to "Hellenic Republic (Greece)" for AR/367/3573 and AR/456/2388.

Thanks,

Paul

OK Thansk Paul   for quick response. We will update data as per your above comment.

Hi Harsh and Paul ,

Here is an updated Article Citator Master List with the updates above:

ISLG - Article Citator Master (3-Dec-20).xlsm 6.62 MB • Download

Note Paul that this file is contained here: I:\Shared\ISLG\Database Development & Maintenance\ISLG Rebuild\Data Migration for future reference. Also, if making corrections, please ensure the People tab is updated as well.

Thanks,

Morgan

 

Noted the file location, Morgan . Ok, I'll also update the People tab the next time.

Thanks,

Paul

Great. Thanks Paul .

Also, Nafiseh , during my update, I noticed that there were a few instances where duplicate UINs assigned to newly added Lawyers (I corrected the errors in the master list). For the next several weeks, let's be extra careful that this doesn't occur so that we can efficiently make our updates when the new application is released.

Thanks,

Morgan 

Hi Morgan ,

I am sorry for these errors. I’ll make sure I’ll be more careful when updating Article Citator Master. 

Thanks,

Nafiseh

No worries, Nafiseh .

Thanks,

Morgan

Hi Morgan , Paul ,

Following People UIN are associated in Tribunal tab in ISLG Article Citator Master Sheet but those UIN are not available in People Tab. 

There are total 129 People UIN which are not available in People Master but those are associated in Tribunal Tab as Member UIN.

AR/0003
AR/0005
AR/0007
AR/0012
AR/0014
AR/0018
AR/0020
AR/0022
AR/0032
AR/0036
AR/0042
AR/0043
AR/0044
AR/0045
AR/0053
AR/0062
AR/0069
AR/0070
AR/0072
AR/0074
AR/0076
AR/0077
AR/0079
AR/0081
AR/0083
AR/0085
AR/0109
AR/0110
AR/0111
AR/0113
AR/0119
AR/0120
AR/0121
AR/0126
AR/0132
AR/0140
AR/0142
AR/0156
AR/0163
AR/0174
AR/0180
AR/0182
AR/0183
AR/0187
AR/0191
AR/0192
AR/0194
AR/0195
AR/0211
AR/0215
AR/0220
AR/0224
AR/0231
AR/0233
AR/0239
AR/0242
AR/0243
AR/254/4160
AR/255/4841
AR/258/4785
AR/266/0825
AR/269/7023
AR/284/7491
AR/286/5175
AR/302/9457
AR/305/1940
AR/308/5287
AR/308/5928
AR/320/8025
AR/321/0290
AR/321/2225
AR/322/2470
AR/323/6588
AR/324/9310
AR/330/8413
AR/338/9096
AR/342/0995
AR/343/1900
AR/345/9419
AR/357/9063
AR/358/7267
AR/365/3700
AR/372/9825
AR/373/8743
AR/376/0424
AR/380/2795
AR/382/1833
AR/387/3892
AR/397/0324
AR/398/7766
AR/401/6636
AR/415/4320
AR/419/8276
AR/420/9019
AR/429/3532
AR/438/2969
AR/439/0117
AR/439/5032
AR/440/2575
AR/443/5100
AR/444/5737
AR/448/7499
AR/450/9710
AR/451/0399
AR/454/4053
AR/458/4557
AR/463/0678
AR/464/5691
AR/473/7439
AR/474/9264
AR/477/2238
AR/503/3897
AR/505/3565
AR/507/4833
AR/507/8021
AR/511/2758
AR/516/1905
AR/521/6691
AR/523/1860
AR/524/9615
AR/530/2791
AR/536/5963
AR/541/2450
AR/548/5810
AR/549/4114
AR/549/4383
AR/573/3682
AR/598/4582
AR/785/3266

We are not able to migrate above people data for Tribunal Data.


Please confirm. 

Hi Morgan and Paul ,

For Organization Master the Following UIN is available multiple time. so for Counsel Claimant data which UIN will consider to associated for Counsel Claimant Organization

  LF/035  | Ignacio Colombres Garmendia
  LF/035  | Ignacio Colombres Garmendia y Asociados

Hi Harsh ,

I'll take a look at the missing entries in the People tab, and provide you with an updated Article Citator Master List.

However, Paul and Nafiseh , could you please take a look at the duplicate UIN issue for LF/0035. I assume these can be combined into one entries, but please confirm.

Thanks,

Morgan

Hi Morgan ,

Yes, they should be combined into one entry. It should be LF/035 (Ignacio Colombres Garmendia & Asociados) according to the Law Firm's website. I updated both our working Article Citator Master List and the one saved here: I:\Shared\ISLG\Database Development & Maintenance\ISLG Rebuild\Data Migration.

Thanks,

Nafiseh

Hi Morgan ​, Paul ​, Nafiseh ​,

If you are going to provide those 129 people master entry then please provide in new sheet or tab which contains only those 129 data.

Because we have already migrated the people data and it is difficult for us to migrate those data from again people tab.

Hence,  if all entries are new then please provide only those entries in new sheet with same format.

Nafiseh , thanks for making the update.

Hi  Harsh ,

Here is an updated Article Citator Master List:

ISLG - Article Citator Master (3-Dec-20).xlsm 7.28 MB • Download

The problem was not in the People tab, but the Tribunal tab. When I consolidated entries in the Lawyer and Arbitrator tabs into the People tab, I neglected to update the Member UINs for the Tribunal tab for those entries where the Arbitrator UIN was replaced with the Lawyer UIN. All the applicable updated entries are updated in yellow:

image.png 213 KB • Download

Note that this change does not effect on the People master list. No additional entries are required. 

Let me know if you have any questions or concerns.

Thanks,

Morgan

Hi Morgan and Paul ,

There are following 2 disputes are not available in Dispute Data in UIN Master Spreadsheet.

But, The Dispute Documents are associated with following 2 disputes in UIN Master Sheet.

1) UN/0324
2) UN/0335


Please confirm what we do ?

Hi Harsh :

You can ignore UN/0324 and UN/0335. I have deleted UN/0324/01 and UN/0335/01 from the attached Dispute Documents tab. UN/0324/01 became IC/0567/01 and UN/0335/01 became IC/0595/01.

Thanks,

UIN Master List (3-Dec-20).xlsx 6.19 MB • Download

Paul 

Hi Harsh ,

Following-up on our call this morning, please proceed with the XML conversion process by converting all documents that are marked with "Full XML Document" and "XML Excerpts" under column W in the BIT and Treaties tab and column R in the Arbitration Rules tab  of the UIN Master List (3-Dec-20):

image.png 503 KB • Download

image.png 408 KB • Download

In addition, any documents marked with "Placeholder referring PDF",
"Placeholder with Citation and URL" and "Placeholder with Citation and no URL" should not be converted nor the PDF migrated; however, the relevant data from the XMLs should pulled to populate for Full Citation, URL and URL Display fields within the master list entries (more details available on how data should be pulled is available here: Re: XML to HTML Coding - TOLOGIX - PDF to HTML Conversion).

Note that this a departure from the instructions contained in the ISLG Data Migration Map: https://docs.google.com/spreadsheets/d/1Ho_yBR8gfCIqivmvkPy_hISkDGozdWsXxn46ImeQ-V4/edit#gid=0

image.png 382 KB • Download

which instructs you to pull the data from the XML Document List. However, this information can now be pulled directly from the UIN Master List and the relevant XML documents.

IMPORTANT: Having said that, could you please confirm that, with the exception of above, all data for the migration are being pulled according to the steps and sources outlined in the ISLG Data Migration Map? I want to confirm that we're following the same steps as first migration, because the issue above should have been spotted as a problem if we were following the map.

Thanks,

Morgan

Hi Harsh ,

Following-up on your email, here is the latest version of the XML Document List:

XML_Document-List_2811_FianlCopy_ForMorgan.xlsx 8.46 MB • Download

Note that this documents is current as of 28 November 2020. Since that time, 89 placeholder XML documents have been added to this system.

Thanks,

Morgan

Hi Morgan and Paul ,

In Current Live ISLG, The Following 2 UIN have associated with Subject Navigator Cross reference branch. 

Also, The above 2 UIN are associated with Treaty category  in current Live ISLG.

but, Those UIN are not available in our UIN Master List Sheet (BIT and Treaties Tab)

Please clarify.

 Hi Harsh ,

Could you direct us to the relevant branches in the Subject Navigator where these cross references occur? There is probably a problem with cross references that need to be updated, but there is no way for us to identify the relevant branches on the admin site: https://www.investorstatelawguide.com/masterTree/index?rootNodeID=&expandList=,1#.

Thanks,

Morgan 

Hi Harsh ,

Following-up on our conversation this morning about the XML Document List and the placeholders XMLs, I'm going to post a to-do above to provide more details and ensure we're aligned on the solution.

Also, could you please post further questions related to the migration in to-do's above, rather than comments. It will make it much easier for us to track these issues.

Thanks,

Morgan 

Hi Morgan ,

There are lost of subject cross reference branches which are associated with following 2 UIN.

It is difficult for us  to provide all branches. Following, I have provided one example for that the following branch is associated with ARB/0017.

https://www.investorstatelawguide.com/MasterTree/Addnode?toc=editNode&rootNodeID=&expandList=1,25889,26101,26102,43856&nodeID=43858&parentID=43856&addLevel=&dataType=2&buttonEdit=Edit%2FRef.&nodeRadio=43858.

The concern is these 2 UIN are available in islg live application as treaty category but in our UIN master list these 2 UIN are not available.

Can we add those 2 UIN in Treaty Master ?

Hi Harsh :

There is no issue with your example above, and the branch does not need any updating.

It appears like there is a reason why ARB/0017 and ARB/0057 appear under "B - Investment Treaties" instead of "A - Arbitration Rules" despite the UINs.

Most ARB/#### generally appear under "Arbitration Rules" category under Article Citator as shown below.

image.png 129 KB • Download

However, ARB/0017 ICSID Rules (1965) - Report of the Executive Directors appears under "International Treaties  & Rules" category of Article Citator as shown below: https://www.investorstatelawguide.com/ResearchTools/ArticleCitator?toc=content&id=201&cat=investmenttreaty&subcat=intlawrules

image.png 91.2 KB • Download

Also, ARB/0057 IBA Rules on the Taking of Evidence in International Arbitration (2010) appears under "Other" category of Article Citator as shown below instead of Arbitration Rules: https://www.investorstatelawguide.com/ResearchTools/ArticleCitator?toc=content&id=201&cat=investmenttreaty&subcat=other

image.png 77.2 KB • Download

Pending Morgan 's approval, I am ok with you adding ARB/0017 and ARB/0057 to the "BIT and Treaties" tab of the UIN Master List Sheet.

Thanks,

Paul

Hi Paul ,

Yes, let's move ARB/0017 and ARB/0057 to the BIT and Treaties tab in the UIN Master List. Could you please make the appropriate updates and send an updated copy of the December 3rd version for Harsh .

Harsh , please manually override the UIN requirements for these master list entries to ensure there is continuity in the UINs throughout the system.

Thanks,

Morgan 

Hi Harsh :

I've moved ARB/0017 and ARB/0057 from "Arbitration Rules" tab to "BIT and Treaties" tab. Attached UIN Master List reflects the change and is saved here: \\EgnyteDrive\islg\Shared\ISLG\Database Development & Maintenance\ISLG Rebuild\Data Migration. 

Thanks,

Paul

UIN Master List (3-Dec-20).xlsx 6.19 MB • Download