TOLOGIX - ISLG App Rebuild

Provision extract not working 2

Assigned to
Martin Laporte, CTO at Tologix Martin L.

Comments & Events

Paul Moon
Hi Martin Laporte, CTO at Tologix Martin :

This is a regression issue from Re: Provision extract not working - TOLOGIX - ISLG App Rebuild that affects users on app.islg. Whenever user clicks on provision extract, it should load the HTML text as in the first example of ILC Article 15. Please add it to unplanned/critical.

ILC Draft Articles on State Responsibility with Commentaries (2001) Article 15

Thanks,

Paul
Martin Laporte, CTO at Tologix
Hi Paul Moon Paul , this seems like a document issue.
Perhaps duplicate IDs or some other issue with the actual HTML of the document.

Harsh Parikh, Tech Lead at DevIT Harsh : I have created DevOps task https://dev.azure.com/tologix/ISLGRebuild/_workitems/edit/2126 in the current sprint.
Please make sure to log a [tech] comment in the task.

Thanks,
-Martin
Harsh Parikh, Tech Lead at DevIT
Hi Paul Moon Paul ,

This issue is resolved on staging.islg. Please check and confirm.

Martin Laporte, CTO at Tologix Martin , I have explained [Tech] in Devops task and all will discuss this task in our scrum call.
Martin Laporte, CTO at Tologix
Hi Harsh Parikh, Tech Lead at DevIT Harsh and Paul Moon Paul ,

I have tested on staging, and provision extracts are working well now:
Martin Laporte, CTO at Tologix
Hi Harsh Parikh, Tech Lead at DevIT Harsh , can you install on app.islg?

Thanks,
-Martin
Harsh Parikh, Tech Lead at DevIT
Hi Martin Laporte, CTO at Tologix Martin ,

Is it urgent for you ? Because I need to publish the dll on production and it is difficult because some other tasks are in progress mode.
Martin Laporte, CTO at Tologix
Hi Harsh Parikh, Tech Lead at DevIT Harsh ,

In this case, it can wait until deployment of other Sprint 22 items next week.
Martin Laporte, CTO at Tologix
Martin Laporte completed this to-do.
Martin Laporte, CTO at Tologix
This was installed on app.islg today.
Marking it as complete.
Paul Moon
Paul Moon re-opened this to-do.
Paul Moon
Hi Martin Laporte, CTO at Tologix Martin :

Provision extracts are not working properly as shown below again for the ICSID Convention Article 25 sub-provisions. Article 25 is working, but any sub-provisions (e.g., Article 25(1) or Article 25(2)) aren't. Could Sharmila add a script to run in order to catch this issue going forward?


Thanks,

Paul
Paul Moon
Paul Moon completed this to-do.
Paul Moon
Paul Moon re-opened this to-do.
Paul Moon
Hi Harsh Parikh, Tech Lead at DevIT Harsh :

I am concerned this is becoming an endemic problem that I find periodically. As shown below, "World Bank Guidelines on the Treatment of Foreign Direct Investment" cannot load any of provision extracts. How could we avoid this regression issue?

Martin Laporte, CTO at Tologix Martin : is this something we could potentially script test on even if it is a long list? 

Thanks,

Paul
Harsh Parikh, Tech Lead at DevIT
Hi Paul Moon Paul ,

This issue is resolved. on app.islg. Please check and confirm.

As, we already discussed this issue with Martin ago as we developed one mechanism that this kind of html we find then will add UIN in database table nd then it will be works fine as per code. As this issue is in html ids and it is not technically feasible to find this kind of documents through script.

I will discuss with Martin once he will back.

Cc : Martin Laporte, CTO at Tologix Martin  
Paul Moon
Thanks for your response, Harsh Parikh, Tech Lead at DevIT Harsh . The issue is resolved for this specific instrument.

Martin Laporte, CTO at Tologix Martin : if we cannot run a script to identify the same issue throughout Article Citator, is our only recourse manually checking every instrument? Please let me know.

Paul
Paul Moon
Hi Martin Laporte, CTO at Tologix Martin :

If running a script is not an option, how could we spot provision extracts breaking down from time to time? Is the script that Harsh is describing the same as Sharmila's test script? If not, could Sharmila specifically work on this script?

Thanks,

Paul
Martin Laporte, CTO at Tologix
Hi Harsh Parikh, Tech Lead at DevIT Harsh ,

Let's discuss this topic on Thursday.

Thanks,
-Martin
Martin Laporte, CTO at Tologix
Hi Paul Moon Paul ,

Harsh Parikh, Tech Lead at DevIT Harsh and I have discussed this topic yesterday. We are devising a potential multi-steps plan to perform an audit for that particular issue.

Harsh Parikh, Tech Lead at DevIT Harsh is looking into the feasibility and will circle back in this thread.

Thanks,
-Martin
Paul Moon Sounds good.
Paul Moon
Hi Harsh Parikh, Tech Lead at DevIT Harsh :

I want to ensure this stays on your radar.

Martin Laporte, CTO at Tologix Martin : Please create a DevOps item if necessary.

Thanks,

Paul
Martin Laporte, CTO at Tologix
I spoke with Harsh Parikh, Tech Lead at DevIT Harsh today. He will post his proposed process here on Friday.
I will make sure to create a devops item for it once we agree on the steps.

-Martin
Paul Moon
Hi Martin Laporte, CTO at Tologix Martin :

Please follow up with Harsh Parikh, Tech Lead at DevIT Harsh , as it's been over a week since the last post.

Thank you,

Paul
Paul Moon
Hi Martin Laporte, CTO at Tologix Martin :

I see DevOps 2316 above is marked as Done, and you had a comment to Harsh Parikh, Tech Lead at DevIT Harsh on Monday which isn't answered yet - could you follow up and see if this is something Sharmila's script could eventually detect or not before I decide to close this?

Thanks,

Paul
Martin Laporte, CTO at Tologix
Hi Paul Moon Paul ,

This task is now in my court.

The DevOps item is closed because Dev-IT completed their part, which was to pull a list of provision extracts that may potentially not match the IDs in our HTML documents.

The next step - which I am currently working on - is to create a Python script that will scan HTML documents, and attempt to compare with the values we have in our SQL database. I still need to reach out to Harsh to make sure my script will perform the correct steps.

I plan on discussing with Harsh Parikh, Tech Lead at DevIT Harsh when they are back on Friday.

Thanks,
-Martin
Paul Moon
Sounds good, Martin Laporte, CTO at Tologix Martin . I'll leave this item open until you update the progress here.

Thanks,

Paul
Martin Laporte, CTO at Tologix
Hi Paul Moon Paul ,

I was finally able to complete my audit. I have found over 2,000 issues.
Each issue identified is a provision that was enabled for the Citator, but that will not work if used (meaning that the Provision Extract - for example - would show a blank window).

More than 75% (1,524) of the issues found come from 10 documents:
OTI/0022 (501 issues)
ARB/0055 (234 issues)
BIT/0742 (157 issues)
OTI/0062 (145 issues)
OTI/0005 (140 issues)
FTA/0041 (89 issues)
OTI/0002 (83 issues)
BIT/0695 (64 issues)
BIT/0395 (63 issues)
BIT/0129 (48 issues)

I am attaching a spreadsheet with the details.


I think that we will need to tackle these in 2 parts:
  1. Content team makes the first pass at understanding and correcting some of the issues. When necessary, they insert notes for the Dev team.
  2. The Dev team addresses all the issues left after the Content team has done their pass. Note that this task - depending on how many issues remain - might be time consuming, as it may involve having to manually adjust the HTML documents. We will need to further discuss once we get to that step.

Thanks,
-Martin

CC: Irit Weinfeld Irit and Harsh Parikh, Tech Lead at DevIT Harsh  
Paul Moon
Hi Irit Weinfeld Irit :

Do you mind taking a look at the spreadsheet that Martin Laporte, CTO at Tologix Martin posted and weed out the ones that shouldn't be flagged as provision extract to be displayed? I see some provisions on the list are under a placeholder (citation and source) and I doubt we XML/HTML'd all the legal instrument on the list. 

Please post your edited spreadsheet here.

Thanks,

Paul
Paul Moon
Hi Irit Weinfeld Irit :

It looks like this one slipped through the cracks. Please have a look at the spreadsheet as mentioned above and let us know.

Thanks,

Paul
Irit Weinfeld
Hi Paul Moon Paul and Martin Laporte, CTO at Tologix Martin ,

The provision extract issue has not been resolved. I will post a video tomorrow at the latest.

Thank you,
Irit
Irit Weinfeld
Hi Paul Moon Paul , Martin Laporte, CTO at Tologix Martin , Harsh Parikh, Tech Lead at DevIT Harsh  

There are still provision extract issues.  

Using BIT/0129 as an example.  For this one, please ignore the extra/duplicate provisions from the provision list. 
  •  The Article paragraph provisions do work on the live site.  However, the sub-paragraph provision extracts do not work on the live site.
    For example:
    Article2(1)
     Article3(1)
    Article3(2)

Please have a look at the HTML coding for BIT/0129 HTML and let us know if there's an issue with the provision ID tags. 
And please have a look at the Article sup-paragraph provisions in the provision list for BIT/0129 on app.islg and let us know if the provision that are selected are being pulled from the HTML.
Harsh Parikh, Tech Lead at DevIT
Hi Martin Laporte, CTO at Tologix Martin ,

We checked issue and found that this document and provisions we migrated from legacy application. now scenario is in provision table the provision number stored without parenthesis : Art2.1 and html the Id having parenthesis : Art2.1).

Due to this reason our code doesn't match database value with html id. For this thing we need to update the code in backend side.

But my concern is this is only one case. might be there are many cased where Database provision and html id are not matching so how we will Identify ??

We will discuss more in Monday's call.

Irit Weinfeld Irit Piyush Kanpariya, DevIT Piyush  
Paul Moon
Hi Martin Laporte, CTO at Tologix Martin :

What was the conclusion with this item after your call?

Thanks,

Paul
Martin Laporte, CTO at Tologix
Hi Paul Moon Paul , I do not recall if we ended up discussing this, and/or what was the outcome.

Hi Harsh Parikh, Tech Lead at DevIT Harsh : do you remember? If not, I can schedule a short meeting with the 3 of us.
Harsh Parikh, Tech Lead at DevIT
Hi Martin Laporte, CTO at Tologix Martin and Paul Moon Paul  

I thought we resolved this issue as we updated at code level and match the HTML ID with stored provision in database.
Irit Weinfeld
Hi Martin Laporte, CTO at Tologix Martin ,

I do not believe this was resolved.

Using the same example from the video I provided above:

Live staging site:
Belgium - Luxembourg - Egypt BIT (1999) [English translation] (BIT/0129)
Article 2(1)



BIT/0129, Article 2(1), when I click on "provision extract", this is what we see:

We want to see the following text taken from the HTML for BIT/0129 Article 2(1):

If we look at the HTML coding for BIT/0129 HTML, we see that there is an HTML ID tag for Article 2.1


Martin Laporte, CTO at Tologix Martin , please let me know when is a good time to have a call about this.

Thanks,
Irit
Paul Moon
Hi Harsh Parikh, Tech Lead at DevIT Harsh :

We need to come up with a solution to separate sub-provisions (e.g., Article 2(1) and Article 3(1)) from the main provisions (e.g., Article 2 and Article 3) in extracts when user selects a sub-provision. It presently shows all sub-provisions when a user clicks on the main provision (which is fine, e.g., Article 2) as shown below but nothing when a user clicks on a sub-provision (e.g., Article 2(1)).


Thanks,

Paul
Harsh Parikh, Tech Lead at DevIT
Hi Irit Weinfeld Irit   and Paul Moon Paul ,

This issue is resolved on aap.islg and staging.islg. Please check and confirm.

Martin Laporte, CTO at Tologix Martin  
Paul Moon
Hi Irit Weinfeld Irit

I will let you respond to this, but please leave it open until it is deployed to app.islg (after the end of this sprint). Could you also check a few other BITs to ensure that it is resolved everywhere? 

Thanks, 

Paul
Irit Weinfeld Will do! 👍
Irit Weinfeld
Hi Paul Moon Paul and everyone,

I tested the following on app.islg staging live site and the issue is resolved:

BIT/0129 Belgium - Luxembourg - Egypt BIT (1999) [English translation] 
BIT/0286 Barbados - Canada BIT (1996)
OTI/0002 Energy Charter Treaty (1994) (excerpts)
OTI/0005 ILC Draft Articles on State Responsibility with Commentaries (2001)

Thank you,
Irit
Paul Moon
Hi Irit Weinfeld Irit :

You mean staging.islg live site, not app.islg, right?

Harsh Parikh, Tech Lead at DevIT Harsh : I will leave it open until deployed to app.islg, thanks.

Paul
Irit Weinfeld
Hi Paul Moon Paul ,

Yes, I meant to type staging.islg live site.

Irit
Paul Moon 👍
Harsh Parikh, Tech Lead at DevIT
Hi Paul Moon Paul and Irit Weinfeld Irit ,

This task is already deployed on app.islg. You can check and confirm.

Martin Laporte, CTO at Tologix Martin  
Irit Weinfeld Will do! 👍
Irit Weinfeld
Hi Paul Moon Paul and everyone,

I ran tests on app.islg live site and the issue is resolved there as well.

Paul Moon Paul , please let me know if I can go ahead and mark this task as complete.

Thank you,
Irit
Paul Moon Please do.
Irit Weinfeld
Irit Weinfeld completed this to-do.