This is a regression issue from Re: Provision extract not working - TOLOGIX - ISLG App Rebuild that affects users on app.islg. Whenever user clicks on provision extract, it should load the HTML text as in the first example of ILC Article 15. Please add it to unplanned/critical.
ILC Draft Articles on State Responsibility with Commentaries (2001) Article 15
Is it urgent for you ? Because I need to publish the dll on production and it is difficult because some other tasks are in progress mode.
Notified 3 people
Martin Laporte,CTO
Hi
Harsh
,
In this case, it can wait until deployment of other Sprint 22 items next week.
Notified 3 people
Martin Laporte completed this to-do.
Martin Laporte,CTO
This was installed on app.islg today. Marking it as complete.
Notified 3 people
Paul Moon re-opened this to-do.
Paul Moon
Hi
Martin
:
Provision extracts are not working properly as shown below again for the ICSID Convention Article 25 sub-provisions. Article 25 is working, but any sub-provisions (e.g., Article 25(1) or Article 25(2)) aren't. Could Sharmila add a script to run in order to catch this issue going forward?
I am concerned this is becoming an endemic problem that I find periodically. As shown below, "World Bank Guidelines on the Treatment of Foreign Direct Investment" cannot load any of provision extracts. How could we avoid this regression issue?
Martin
: is this something we could potentially script test on even if it is a long list?
Thanks,
Paul
Notified 3 people
Harsh Parikh,Tech Lead
Hi
Paul
,
This issue is resolved. on app.islg. Please check and confirm.
As, we already discussed this issue with Martin ago as we developed one mechanism that this kind of html we find then will add UIN in database table nd then it will be works fine as per code. As this issue is in html ids and it is not technically feasible to find this kind of documents through script.
I will discuss with Martin once he will back.
Cc :
Martin
Notified 3 people
Paul Moon
Thanks for your response,
Harsh
. The issue is resolved for this specific instrument.
Martin
: if we cannot run a script to identify the same issue throughout Article Citator, is our only recourse manually checking every instrument? Please let me know.
Paul
Notified 3 people
Paul Moon
Hi
Martin
:
If running a script is not an option, how could we spot provision extracts breaking down from time to time? Is the script that Harsh is describing the same as Sharmila's test script? If not, could Sharmila specifically work on this script?
Thanks,
Paul
Notified 3 people
Martin Laporte,CTO
Hi
Harsh
,
Let's discuss this topic on Thursday.
Thanks, -Martin
Notified 3 people
Martin Laporte,CTO
Hi
Paul
,
Harsh
and I have discussed this topic yesterday. We are devising a potential multi-steps plan to perform an audit for that particular issue.
Harsh
is looking into the feasibility and will circle back in this thread.
Thanks, -Martin
Sounds good.
Notified 3 people
Paul Moon
Hi
Harsh
:
I want to ensure this stays on your radar.
Martin
: Please create a DevOps item if necessary.
Thanks,
Paul
Notified 3 people
Martin Laporte,CTO
I spoke with
Harsh
today. He will post his proposed process here on Friday. I will make sure to create a devops item for it once we agree on the steps.
-Martin
Notified 2 people
Paul Moon
Hi
Martin
:
Please follow up with
Harsh
, as it's been over a week since the last post.
I see DevOps 2316 above is marked as Done, and you had a comment to
Harsh
on Monday which isn't answered yet - could you follow up and see if this is something Sharmila's script could eventually detect or not before I decide to close this?
Thanks,
Paul
Notified 2 people
Martin Laporte,CTO
Hi
Paul
,
This task is now in my court.
The DevOps item is closed because Dev-IT completed their part, which was to pull a list of provision extracts that may potentially not match the IDs in our HTML documents.
The next step - which I am currently working on - is to create a Python script that will scan HTML documents, and attempt to compare with the values we have in our SQL database. I still need to reach out to Harsh to make sure my script will perform the correct steps.
I plan on discussing with
Harsh
when they are back on Friday.
Thanks, -Martin
Notified 2 people
Paul Moon
Sounds good,
Martin
. I'll leave this item open until you update the progress here.
Thanks,
Paul
Notified 4 people
Martin Laporte,CTO
Hi
Paul
,
I was finally able to complete my audit. I have found over 2,000 issues. Each issue identified is a provision that was enabled for the Citator, but that will not work if used (meaning that the Provision Extract - for example - would show a blank window).
More than 75% (1,524) of the issues found come from 10 documents: OTI/0022 (501 issues) ARB/0055 (234 issues) BIT/0742 (157 issues) OTI/0062 (145 issues) OTI/0005 (140 issues) FTA/0041 (89 issues) OTI/0002 (83 issues) BIT/0695 (64 issues) BIT/0395 (63 issues) BIT/0129 (48 issues)
I think that we will need to tackle these in 2 parts:
Content team makes the first pass at understanding and correcting some of the issues. When necessary, they insert notes for the Dev team.
The Dev team addresses all the issues left after the Content team has done their pass. Note that this task - depending on how many issues remain - might be time consuming, as it may involve having to manually adjust the HTML documents. We will need to further discuss once we get to that step.
Thanks, -Martin
CC:
Irit
and
Harsh
Notified 4 people
Paul Moon
Hi
Irit
:
Do you mind taking a look at the spreadsheet that
Martin
posted and weed out the ones that shouldn't be flagged as provision extract to be displayed? I see some provisions on the list are under a placeholder (citation and source) and I doubt we XML/HTML'd all the legal instrument on the list.
Please post your edited spreadsheet here.
Thanks,
Paul
Notified 4 people
Paul Moon
Hi
Irit
:
It looks like this one slipped through the cracks. Please have a look at the spreadsheet as mentioned above and let us know.
Thanks,
Paul
Notified 4 people
Irit Weinfeld
Hi
Paul
and
Martin
,
The provision extract issue has not been resolved. I will post a video tomorrow at the latest.
Thank you, Irit
Notified 4 people
Irit Weinfeld
Hi
Paul
,
Martin
,
Harsh
There are still provision extract issues.
Using BIT/0129 as an example. For this one, please ignore the extra/duplicate provisions from the provision list.
The Article paragraph provisions do work on the live site. However, the sub-paragraph provision extracts do not work on the live site. For example: Article2(1) Article3(1) Article3(2)
Please have a look at the HTML coding for BIT/0129 HTML and let us know if there's an issue with the provision ID tags. And please have a look at the Article sup-paragraph provisions in the provision list for BIT/0129 on app.islg and let us know if the provision that are selected are being pulled from the HTML.
We checked issue and found that this document and provisions we migrated from legacy application. now scenario is in provision table the provision number stored without parenthesis : Art2.1 and html the Id having parenthesis : Art2.1).
Due to this reason our code doesn't match database value with html id. For this thing we need to update the code in backend side.
But my concern is this is only one case. might be there are many cased where Database provision and html id are not matching so how we will Identify ??
We will discuss more in Monday's call.
Irit
Piyush
Notified 5 people
Paul Moon
Hi
Martin
:
What was the conclusion with this item after your call?
Thanks,
Paul
Notified 5 people
Martin Laporte,CTO
Hi
Paul
, I do not recall if we ended up discussing this, and/or what was the outcome.
Hi
Harsh
: do you remember? If not, I can schedule a short meeting with the 3 of us.
Notified 5 people
Harsh Parikh,Tech Lead
Hi
Martin
and
Paul
I thought we resolved this issue as we updated at code level and match the HTML ID with stored provision in database.
Notified 5 people
Irit Weinfeld
Hi
Martin
,
I do not believe this was resolved.
Using the same example from the video I provided above:
Live staging site: Belgium - Luxembourg - Egypt BIT (1999) [English translation] (BIT/0129) Article 2(1)
Martin
, please let me know when is a good time to have a call about this.
Thanks, Irit
Notified 5 people
Paul Moon
Hi
Harsh
:
We need to come up with a solution to separate sub-provisions (e.g., Article 2(1) and Article 3(1)) from the main provisions (e.g., Article 2 and Article 3) in extracts when user selects a sub-provision. It presently shows all sub-provisions when a user clicks on the main provision (which is fine, e.g., Article 2) as shown below but nothing when a user clicks on a sub-provision (e.g., Article 2(1)).
Let me know if you prefer discussing in a Zoom session with Paul, Irit and me.
Thanks, -Martin
Notified 5 people
Harsh Parikh,Tech Lead
Hi
Irit
and
Paul
,
This issue is resolved on aap.islg and staging.islg. Please check and confirm.
Martin
Notified 5 people
Paul Moon
Hi
Irit
:
I will let you respond to this, but please leave it open until it is deployed to app.islg (after the end of this sprint). Could you also check a few other BITs to ensure that it is resolved everywhere?
Thanks,
Paul
Will do! 👍
Notified 5 people
Irit Weinfeld
Hi
Paul
and everyone,
I tested the following on app.islg staging live site and the issue is resolved:
BIT/0129 Belgium - Luxembourg - Egypt BIT (1999) [English translation] BIT/0286 Barbados - Canada BIT (1996) OTI/0002 Energy Charter Treaty (1994) (excerpts) OTI/0005 ILC Draft Articles on State Responsibility with Commentaries (2001)
Thank you, Irit
Notified 5 people
Paul Moon
Hi
Irit
:
You mean staging.islg live site, not app.islg, right?
Harsh
: I will leave it open until deployed to app.islg, thanks.
Paul
Notified 5 people
Irit Weinfeld
Hi
Paul
,
Yes, I meant to type staging.islg live site.
Irit
👍
Notified 5 people
Harsh Parikh,Tech Lead
Hi
Paul
and
Irit
,
This task is already deployed on app.islg. You can check and confirm.
Martin
Will do! 👍
Notified 5 people
Irit Weinfeld
Hi
Paul
and everyone,
I ran tests on app.islg live site and the issue is resolved there as well.
Paul
, please let me know if I can go ahead and mark this task as complete.
This is a regression issue from Re: Provision extract not working - TOLOGIX - ISLG App Rebuild that affects users on app.islg. Whenever user clicks on provision extract, it should load the HTML text as in the first example of ILC Article 15. Please add it to unplanned/critical.
ILC Draft Articles on State Responsibility with Commentaries (2001) Article 15
Thanks,
Paul
Perhaps duplicate IDs or some other issue with the actual HTML of the document.
Please make sure to log a [tech] comment in the task.
Thanks,
-Martin
This issue is resolved on staging.islg. Please check and confirm.
I have tested on staging, and provision extracts are working well now:
Thanks,
-Martin
Is it urgent for you ? Because I need to publish the dll on production and it is difficult because some other tasks are in progress mode.
In this case, it can wait until deployment of other Sprint 22 items next week.
Marking it as complete.
Provision extracts are not working properly as shown below again for the ICSID Convention Article 25 sub-provisions. Article 25 is working, but any sub-provisions (e.g., Article 25(1) or Article 25(2)) aren't. Could Sharmila add a script to run in order to catch this issue going forward?
Thanks,
Paul
I am concerned this is becoming an endemic problem that I find periodically. As shown below, "World Bank Guidelines on the Treatment of Foreign Direct Investment" cannot load any of provision extracts. How could we avoid this regression issue?
Thanks,
Paul
This issue is resolved. on app.islg. Please check and confirm.
As, we already discussed this issue with Martin ago as we developed one mechanism that this kind of html we find then will add UIN in database table nd then it will be works fine as per code. As this issue is in html ids and it is not technically feasible to find this kind of documents through script.
I will discuss with Martin once he will back.
Cc :
Paul
If running a script is not an option, how could we spot provision extracts breaking down from time to time? Is the script that Harsh is describing the same as Sharmila's test script? If not, could Sharmila specifically work on this script?
Thanks,
Paul
Let's discuss this topic on Thursday.
Thanks,
-Martin
Thanks,
-Martin
I want to ensure this stays on your radar.
Thanks,
Paul
I will make sure to create a devops item for it once we agree on the steps.
-Martin
Please follow up with
Thank you,
Paul
Per our discussion today, I have created DevOps task https://dev.azure.com/tologix/ISLGRebuild/_workitems/edit/2316 to track this.
-Martin
I see DevOps 2316 above is marked as Done, and you had a comment to
Thanks,
Paul
This task is now in my court.
The DevOps item is closed because Dev-IT completed their part, which was to pull a list of provision extracts that may potentially not match the IDs in our HTML documents.
The next step - which I am currently working on - is to create a Python script that will scan HTML documents, and attempt to compare with the values we have in our SQL database. I still need to reach out to Harsh to make sure my script will perform the correct steps.
I plan on discussing with
Thanks,
-Martin
Thanks,
Paul
I was finally able to complete my audit. I have found over 2,000 issues.
Each issue identified is a provision that was enabled for the Citator, but that will not work if used (meaning that the Provision Extract - for example - would show a blank window).
More than 75% (1,524) of the issues found come from 10 documents:
OTI/0022 (501 issues)
ARB/0055 (234 issues)
BIT/0742 (157 issues)
OTI/0062 (145 issues)
OTI/0005 (140 issues)
FTA/0041 (89 issues)
OTI/0002 (83 issues)
BIT/0695 (64 issues)
BIT/0395 (63 issues)
BIT/0129 (48 issues)
I am attaching a spreadsheet with the details.
I think that we will need to tackle these in 2 parts:
Thanks,
-Martin
CC:
Do you mind taking a look at the spreadsheet that
Please post your edited spreadsheet here.
Thanks,
Paul
It looks like this one slipped through the cracks. Please have a look at the spreadsheet as mentioned above and let us know.
Thanks,
Paul
The provision extract issue has not been resolved. I will post a video tomorrow at the latest.
Thank you,
Irit
There are still provision extract issues.
Using BIT/0129 as an example. For this one, please ignore the extra/duplicate provisions from the provision list.
For example:
Article2(1)
Article3(1)
Article3(2)
And please have a look at the Article sup-paragraph provisions in the provision list for BIT/0129 on app.islg and let us know if the provision that are selected are being pulled from the HTML.
Thank you,
Irit
I have created task https://dev.azure.com/tologix/ISLGRebuild/_workitems/edit/2790 under Unplanned issues to track this.
Thanks,
-Martin
We checked issue and found that this document and provisions we migrated from legacy application. now scenario is in provision table the provision number stored without parenthesis : Art2.1 and html the Id having parenthesis : Art2.1).
Due to this reason our code doesn't match database value with html id. For this thing we need to update the code in backend side.
But my concern is this is only one case. might be there are many cased where Database provision and html id are not matching so how we will Identify ??
We will discuss more in Monday's call.
What was the conclusion with this item after your call?
Thanks,
Paul
Hi
I thought we resolved this issue as we updated at code level and match the HTML ID with stored provision in database.
I do not believe this was resolved.
Using the same example from the video I provided above:
Live staging site:
Belgium - Luxembourg - Egypt BIT (1999) [English translation] (BIT/0129)
Article 2(1)
BIT/0129, Article 2(1), when I click on "provision extract", this is what we see:
We want to see the following text taken from the HTML for BIT/0129 Article 2(1):
If we look at the HTML coding for BIT/0129 HTML, we see that there is an HTML ID tag for Article 2.1
Thanks,
Irit
We need to come up with a solution to separate sub-provisions (e.g., Article 2(1) and Article 3(1)) from the main provisions (e.g., Article 2 and Article 3) in extracts when user selects a sub-provision. It presently shows all sub-provisions when a user clicks on the main provision (which is fine, e.g., Article 2) as shown below but nothing when a user clicks on a sub-provision (e.g., Article 2(1)).
Thanks,
Paul
I have added task https://dev.azure.com/tologix/ISLGRebuild/_workitems/edit/3340 to the Unplanned backlog item.
Let me know if you prefer discussing in a Zoom session with Paul, Irit and me.
Thanks,
-Martin
This issue is resolved on aap.islg and staging.islg. Please check and confirm.
I will let you respond to this, but please leave it open until it is deployed to app.islg (after the end of this sprint). Could you also check a few other BITs to ensure that it is resolved everywhere?
Thanks,
Paul
I tested the following on app.islg staging live site and the issue is resolved:
BIT/0129 Belgium - Luxembourg - Egypt BIT (1999) [English translation]
BIT/0286 Barbados - Canada BIT (1996)
OTI/0002 Energy Charter Treaty (1994) (excerpts)
OTI/0005 ILC Draft Articles on State Responsibility with Commentaries (2001)
Thank you,
Irit
You mean staging.islg live site, not app.islg, right?
Paul
Yes, I meant to type staging.islg live site.
Irit
This task is already deployed on app.islg. You can check and confirm.
I ran tests on app.islg live site and the issue is resolved there as well.
Thank you,
Irit