Posted by Melissa Cowell · Feb 18, 2020 at 7:08 PM

Tasks and Analysis Data

Ketan

Harsh

,

Can you please provide your input on the following scenario that has come in discussion:

A document is uploaded and converted, edited and analysis data capture has been performed. Now approve admin finds some issue with the document text and switches the task to 'Edit' in order to update the HTML text.

What happens with the Data Capture analysis? Based on what we've seen in ILG it looks as thought the tagging data will be maintained. Can you confirm?
If the user editing the text deletes and entire tagged excerpt, will the reference data be removed from the relevant research tool?
If the user add/edits text within the excerpt area, will the tagged excerpts be updated in the relevant research tool?

I don't believe this scenario was ever described, so your input would be appreciated. We have not seen all of the task features yet however it seems as though some of this may already be working as we hoped (in ILG) and would love if you could confirm.

Thank you,
Melissa

Comments & Events

Harsh Parikh, Tech Lead

Melissa

,

We are internally discussed above points and mentioned the appropriate answer.

What happens with the Data Capture analysis? Based on what we've seen in ILG it looks as thought the tagging data will be maintained. Can you confirm?

Yes it will be maintained unless user edit/remove the tagged excerpts start text or end text (The start text and end text is explained in 3rd point).

If the user editing the text deletes and entire tagged excerpt, will the reference data be removed from the relevant research tool?

The entire tagged data will be removed from HTML file but its reference will be remain save in database level. (For example, whole Paragraph 1 removed from html editor so there will be no text available in html file for Paragraph 1. But, Paragraph 1 will be displayed in all master tree as a reference because it is already saved on database. It means, if user click on Paragraph 1 from master tree then it redirects to document but it will be not pinpoint to Paragraph 1 )

If the user add/edits text within the excerpt area, will the tagged excerpts be updated in the relevant research tool?

If user add/edit text within excerpt area then tagged excerpts will be updated but if user change the start text or end text (ex. if tagged portion Start Text of section is "ABC" and End Text of selection is "XYZ" Now, If user will change/delete the start text "ABC" or end text "XYZ" then it will remove tagged dependency in tagged excerpt and highlighted portion will be removed.

We are suggesting that we should stop to perform edit task again once it will be completed because HTML text and its elements have so many dependency for tagging excerpts.

Feb 19, 2020 at 11:52 AM Notified 5 people

Morgan Maguire, CEO

Harsh

,

Thanks for the answers above. I've added this to the agenda for discussion tomorrow.

Note that we'll need to maintain the ability to edit HTML text after analysis is performed to ensure we can correct problems with the HTML text that only get discovered after the document is scrutinized through analysis. Therefore, we'll need to build in requirements that will maintain the integrity of the analysis data and notify the admin user when a scenario occurs similar to what you've described above.

Also, the requirements we build will be useful in tacking and correcting issues that arise when migrate data from the old application that may not match-up correctly with the new HTML text and tags in the new application. We could use this as a tool for identifying and resolving problems that would otherwise require trial and error testing by users.

Thanks,

Morgan

Feb 19, 2020 at 11:17 PM Notified 5 people

Jitesh Dhuravala

Morgan

,

We will provide admin to edit HTML text after analysis is performed to ensure we can correct problems with the HTML text that only get discovered after the document is examine through analysis. To achieve this behavior we are planning to do as per following.

1, Admin can change html text as per his/her needs but he/she can not able to changed text of first and last line of paragraph on which admin has already tagged and saved in database. middle of text of tagged html text he/she can change but first and last line should be read only in order to maintain our logic and functionality. Even if Admin want to change first or last line of tagged text than he/she need to delete that particular tagged from document and save than edit html text as per he/she want after that he need to do again tagging.

2, Second, after migration from old to new application all excerpt/tagged paragraph will be migrate and display as per current tagging functionality in new application. but what about those excerpt/tagged which are broken down due to manually added in old application. We would display those broken excerpt/tagged in one notification message so please let us know where we need to display.

Morgan

, This is our approach and planning. Let us know your feedback on this.

Thanks,
Jitesh

Mar 04, 2020 at 1:01 PM Notified 6 people

Morgan Maguire, CEO

Jitesh

,

Re changing HTML text while tagging, understood. Based on what you've described above, assuming there are no tags applied to the applicable text, would the admin user be able to edit all text in the paragraph? Let's discuss tomorrow, but this may work.

Re broken tags post-migration, it's important that the notification message provide a list of the specific tags from the old application that didn't get integrated into the HTML text of the new application. That way the admin user will be able to identify and manually modify/add tags to the HTML text as necessary. Also, we'll need to generate a report after performing the migration that lists all the documents (and applicable tags) where such issues are occurring. Let's discuss how to implement this during tomorrow's call. However,

Melissa

, please put some thought into how we should modify the design of the admin site to accommodate these requirements.

Thanks,

Morgan

Mar 04, 2020 at 6:23 PM Notified 6 people

Morgan Maguire, CEO

Jitesh

Ketan

and

Melissa

,

Further to our discussion this morning, we'll proceeding with resolving the issue above as follows:

DevIT will complete R&D on determining whether we can easily make HTML text read-only when a tag has been inserted into the text. Assuming this can be easily accomplished, we will proceed with requiring the admin user to delete any tags from the HTML text before they are able to edit the HTML.
Re broken tags, after the migration is performed, DevIT will produce a report in a spreadsheet that lists all the documents that have broken tags. The report should include the following data:
- Dispute Document UIN (source document)
- Dispute Document Title (source document)
- Tag Status (e.g., broken)
- List of broken tags, including:
  - Tag Type
    - Subject Navigator
      - Paragraph number in source document
      - Cited Branch Title (and parents branch titles)
    - Article Citator
      - Paragraph/footnote number in source document
      - Document UIN for cited treaty/arbitration rules
      - Provision number for cited treaty/arbitration rules
    - Jurisprudence Citator
      - Paragraph/footnote number in source document
      - Document UIN for cited dispute document/non-investment treaty dispute document
      - Type of citation for cited document
      - Paragraph/page number for cited document
    - Publication Citator
      - Paragraph/footnote number in source document
      - Document UIN for cited publication
      - Paragraph/page number for cited document
    - Terms & Phrases
      - Paragraph/footnote number in source document
      - Document UIN for cited treaty/arbitration rules
      - Provision number for cited treaty/arbitration rules
      - Term or Phrase

Here is sample of the report:

Data Migration Tagging Error Report - Sample.xlsx 184 KB • Download

Note that each type of tag is given it's own tab, and each tag will occupy a row in the report. Therefore, if a document has multiple broken tags across multiple types, it could have multiple rows in multiple tabs.

Let me know you thoughts, and we can discuss in more detail during the call next Thursday.

BTW:

Melissa

if you think it would be worthwhile for you to join the call, let me know and I'll send you the calendar invite details.

Thanks,

Morgan

Mar 06, 2020 at 12:50 AM Notified 6 people

Morgan Maguire, CEO

Ketan

and

Jitesh

,

In preparation for tomorrow's meeting, could you please provide an update on the items above.

Any progress on the R&D?

Is the proposed sample report work for you?

Thanks,

Morgan

Mar 19, 2020 at 12:46 AM Notified 6 people

Jitesh Dhuravala

Morgan

,

Partially we have done R&D about how to HTML text read-only when a tag has been inserted into the text but we have not implement and integrated in our application, We will update you soon.

Yes, you have proposed sample report is fine and understandable.

Thanks,
Jitesh

Mar 19, 2020 at 11:35 AM Notified 6 people

Morgan Maguire, CEO

Jitesh

and

Ketan

,

Could you please provide an update on the above.

Thanks,

Morgan

Mar 31, 2020 at 11:05 PM Notified 6 people

Harsh Parikh, Tech Lead

Morgan

,

We will look into it once ISLG admin cards complete. This is 3 to 4 days R&D task and will complete between 15 to 20th April.

Apr 01, 2020 at 7:54 AM Notified 6 people

Morgan Maguire, CEO

Ok. Sounds good,

Harsh

Melissa

, perhaps we should create a user story on TargetProcess to track progress on this task, and then we can integrate into the Timeline.

Thanks,

Morgan

Apr 01, 2020 at 5:36 PM Notified 6 people

Melissa Cowell, General Manager

Morgan

I have created a card with the relevant details here:
https://industrialagency.tpondemand.com/entity/15093-randd-greater-editing-html-text-after

Mel

Apr 01, 2020 at 5:52 PM Notified 6 people

Morgan Maguire, CEO

Perfect. Thanks

Melissa

.

Morgan

Apr 01, 2020 at 5:52 PM Notified 6 people

Morgan Maguire, CEO

Harsh

,

Could you please provide an update on the progress made concerning R&D on the issue above.

Thanks,

Morgan

Apr 15, 2020 at 2:35 PM Notified 6 people

Harsh Parikh, Tech Lead

Morgan

,

Yes. We are planning to complete this story by 20th April. Team is working on this and will update you once it is completed.

Apr 15, 2020 at 2:37 PM Notified 6 people

Morgan Maguire, CEO

Perfect. Thanks

Harsh

.

Morgan

Apr 15, 2020 at 2:38 PM Notified 6 people

Harsh Parikh, Tech Lead

Morgan

and

Melissa

,

We have completed this R&D and integrated in HTML editor. Now, The HTML text will freeze in html editor if user performed tagged on that html text.

We will deploy this change with other stories on 23rd April.

Apr 20, 2020 at 10:05 AM Notified 6 people

Morgan Maguire, CEO

Ok. Great. Thanks for the update

Harsh

.

Morgan

Apr 20, 2020 at 3:30 PM Notified 6 people

Morgan Maguire, CEO

Harsh

Jitesh

and

Ketan

,

I'm adding this to the agenda for tomorrow's call. Referring to item #2 from my post on March 5th above, I'd like to discuss and confirm that work is being done to prepare and create reporting tools needs to identify and address broken tags that may occur during the final migration.

Thanks,

Morgan

Nov 18, 2020 at 9:04 PM Notified 6 people