TOLOGIX - ISLG App Rebuild

Duplicate References in Publication Citator on the Staging Live Site

Assigned to
Harsh Parikh, Tech Lead at DevIT Harsh P.
Notes
Hi Morgan Maguire, CEO Morgan ,

I noticed that there are duplicate references in Publication Citator on the Staging live site.

The publication I refer to is "Thomas Cottier et al., "The Principle of Proportionality in International Law: Foundations and Variations" 18:4 The Journal of World Investment and Trade 628 (2017)".

When I check the publication citator for SC/0034/02 on the staging admin site, I do not see any issue.


There is no issue under the legacy live site:



Another example is "Christoph H. Schreuer, "Guide to Nationality Planning," Global Arbitration Review (11 May 2012).":


The same issue exists in "Thomas Wälde, “Arbitration in the Oil, Gas and Energy Field: Emerging Energy Charter Treaty Practice” 2 Transnational Dispute Management (2004).":




I noticed in all the examples I found, the duplicates exist in "General" references to the publications not specific references.

I had posted a similar to-do for Jurisprudence Citator when I tested the rebuild live site: Duplicate Pinpoint References in Jurisprudence Citator on the Rebuild Live Site - TOLOGIX - ISLG App Rebuild

Thanks,

Nafiseh

Comments & Events

Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan and Paul Moon Paul ,

We have removed  duplicate all references data from JC & PC module on staging.islg.

Please check and confirm.
Harsh Parikh, Tech Lead at DevIT
Hi Paul Moon Paul and Morgan Maguire, CEO Morgan ,

Please check and confirm. If all OK then will execute script on app.islg as well.
Irit Weinfeld
Hi Morgan Maguire, CEO Morgan , Paul Moon Paul and Harsh Parikh, Tech Lead at DevIT Harsh ,

For Pub Citator, there are still a few duplicate entries appearing on the Live Site. I found the following issue:

Type of citation "Article" and "Chapter" do not appear on staging.islg Admin Site. I do not think this is a migration issue.

Screen capture, legacy.islg Admin Site, Publication Citator uploading tool

Type of citation: Chapter
Example using Publication Citator DCD for: 
  • Dispute Document IC/0052/02 Continental Casualty Company v. Argentine Republic, ICSID Case No. ARB/03/9, Award, 5 September 2008
  • Chapter2 and Chapter 3 in Pub UIN PUB/287/5446 The Organization for Economic Co-operation and Development (OECD), International Investment Law: A Changing Landscape: A Companion Volume to International Investment Perspectives (Paris: OECD, 2005) 

Screen Capture, Publication Citator Master spreadsheet

Screen Capture, staging.islg, Master List, Dispute Document, Analysis List, Publication Citator.  Chapter2 and Chapter3 are blank.

I believe that because the entry is blank in the Analysis List, "Generally" entries for PUB/287/5446 were not captured in Harsh Parikh, Tech Lead at DevIT Harsh 's PC Duplicate List and are therefore still appearing in the database.

Screen Capture, Harsh's PC Duplicate List
Chapter 2 and Chapter 3 entries do appear on the Live Site, however there is no heading for "Chapter(s)":
Screen capture, staging.islg Live Site, Research Tools, Publication Citator, Specific References
Screen capture, staging.islg Live Site, Research Tools, Publication Citator, All References. 
The Red  boxes are references to "generally". The black boxes are references to specific references.  These "generally" references should be removed. 

The issue with Type of citation: Article will be posted below.
Irit Weinfeld
Morgan Maguire, CEO Morgan , Paul Moon Paul and Harsh Parikh, Tech Lead at DevIT Harsh

Continued from my post above.

Type of citation: Article
Example using Publication Citator DCD for: 
  • Dispute Document  IC/0130/10 Philip Morris Brand Sàrl (Switzerland), Philip Morris Products S.A. (Switzerland) and Abal Hermanos S.A. (Uruguay) v. Oriental Republic of Uruguay, ICSID Case No. ARB/10/7, Concurring and Dissenting Opinion, 8 July 2016
  • Article 7 in Pub UIN PUB/210/3568 Harvard Law School, "Draft Convention on the Responsibility of States for Damage done in their Territory to the Person or Property of Foreigners" 23 American Journal of International Law, 131 (1929).

Screen Capture, Publication Citator Master spreadsheet

Screen Capture, staging.islg, Master List, Dispute Document, Analysis List, Publication Citator.  Article 7 is blank.

As mentioned in my post above, I believe that because the entry is blank in the Analysis List, "Generally" entries for PUB/210/3568 were not captured in Harsh Parikh, Tech Lead at DevIT Harsh 's PC Duplicate List and are therefore still appearing in the database.

Screen Capture, Harsh's PC Duplicate List

Article 7 entry does appear on the Live Site, however there is no heading for "Article(s)":
Screen capture, staging.islg Live Site, Research Tools, Publication Citator, Specific References

Screen capture, staging.islg Live Site, Research Tools, Publication Citator, All References.
The Red  box is a reference to "generally". The black box is a references to a specific reference.  This "generally" reference should be removed.


Thank you,
Irit
Morgan Maguire, CEO
Hi Irit Weinfeld Irit ​,

It looks like you've identified a separate issue from the duplicate references that concerns how non-paragraph/page references were migrated from the legacy application.

Harsh Parikh, Tech Lead at DevIT Harsh ​, I'll take a closer look at this issue and provide further detail on the issue. We need to examine how these non-paragraph/page references were originally migrated from the legacy application before you implemented the fix.

I'll take a look and we can discuss during the meeting tomorrow.

Thanks,

Morgan
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan and Irit Weinfeld Irit ,

We looked into this issue and found through automated query that only few Publication have missing non-paragraph/page references which we have updated on both app.islg and staging.islg. Please check and confirm.

We have also checked in JC tool and there is no issue with missing non-paragraph/page references.

We assume there is no issue with Duplicate References in PC tool. Please confirm.
Irit Weinfeld
Hi Harsh Parikh, Tech Lead at DevIT Harsh and Morgan Maguire, CEO Morgan ,

I can confirm that are are no issues with missing non-paragraph/page references in the JC tool.

I will check for duplicate references in the PC tool and report back.

Thanks,
Irit
Morgan Maguire, CEO 👍
Irit Weinfeld
Hi Harsh Parikh, Tech Lead at DevIT Harsh ,

There are still duplicate references in the Publication Citator tool for Type of Citation: "Article(s)" and "Chapter(s)".

References to "generally" and references to "specific references" are both appearing under "All Citations" on staging.islg live site and app.islg live site.

Example, See screen capture, staging.islg Admin Site, Analysis List, Pub Citator:

Screen capture, staging.islg Live Site, Research Tools, Publication Citator, All References.
The Red  box is a reference to "generally". The black box is a references to a specific reference.  This "generally" reference should be removed.


Thank you,
Irit
Morgan Maguire, CEO
Hi Harsh Parikh, Tech Lead at DevIT Harsh ,

Following-up on Irit Weinfeld Irit 's comments above and my video below, it appears that specific references for "Article(s)" and "Chapter(s)" were excluded from the JP PC Duplicate Excerpt List, which then caused them to be excluded from the fix.
As a result, I believe we'll need to update the Excerpt List above to include generally references related to "Article(s)" and "Chapter(s)" specific references and then run the script again on the Publication Citator.

Thanks,

Morgan

Irit Weinfeld 👍
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan and Irit Weinfeld Irit ,

We need to only update duplicate references in Publication for that missing non-paragraph/page references.

We have removed those duplicate generally refrences from those  missing non-paragraph/page references on staging .islg.

Please check and confirm.
Morgan Maguire, CEO
Great. Thanks Harsh Parikh, Tech Lead at DevIT Harsh .

Irit Weinfeld Irit , could you please confirm this issue is resolved on staging.islg.

Thanks,

Morgan
Irit Weinfeld
Hi Morgan Maguire, CEO Morgan , this issue is resolved on staging.islg.

Thank you,
Irit
Morgan Maguire, CEO
Great. Thanks Irit Weinfeld Irit ​.

Harsh Parikh, Tech Lead at DevIT Harsh ​, Looks like this issue is resolved in the Publication Citator and Jurisprudence Citator (https://3.basecamp.com/3691577/buckets/5559242/todos/3380450132). Could you please implement the scripts on app.islg.

Thanks,

Morgan 
Harsh Parikh, Tech Lead at DevIT
Hi Morgan Maguire, CEO Morgan , Irit Weinfeld Irit and Paul Moon Paul ,

We have updated the duplicate data of Jurisprudence & Publication on app.islg. Please check and complete this task.
Morgan Maguire, CEO
Great. Thanks Harsh Parikh, Tech Lead at DevIT Harsh .

Paul Moon Paul and Irit Weinfeld Irit , could you please confirm that everything looks good on app.islg for both the JP and PB Citators.

Thanks,

Morgan
Irit Weinfeld
Hi Morgan Maguire, CEO Morgan Paul Moon Paul and Harsh Parikh, Tech Lead at DevIT Harsh ,

Both JP and PB Citators look good on app.islg.  This issue has been resolved. 

Thank you,
Irit
Morgan Maguire, CEO
Perfect. Thanks Irit Weinfeld Irit . I'll mark both to-do complete.

Morgan
Morgan Maguire, CEO
Morgan Maguire completed this to-do.