TOLOGIX - Infrastructure LawGuide (ILG)

Merging Content between www.ilg and dev.ilg

Hi everyone,

As we prepare to transition to a scrum development process in the weeks ahead (first sprint is scheduled to start on May 10th), my suggestion is that the development team complete the pending task of merging and synchronising data between the production (http://www.infrastructurelawguide.com/) and staging (http://dev.infrastructurelawguide.com) environments for ILG. 

Currently, there is production data within each environment that we need to preserve as part of this process. In particular, we need to preserve the following within ILG production:
  1. Tag Directory: http://www.infrastructurelawguide.com/Admin/Tag Need to preserve the Tag Directory that exists within the production environment.
  2. ON/0133 Project and Documents: http://www.infrastructurelawguide.com/Admin/Document?ProjectId=1 We need to preserve ON/0133 - The Rt. Hon. Herb Gray Parkway (formerly Windsor-Essex Parkway), all documents associated with the project and any tags inserted into the applicable documents.
The following data need to be preserved within ILG staging: 
  1. Projects: http://dev.infrastructurelawguide.com/Admin/Projects We need to preserve all projects and all project data with the exception of ON/0133 - The Rt. Hon. Herb Gray Parkway (formerly Windsor-Essex Parkway) using version available in ILG production.
The remaining data can used from either environment; however, it might make more sense to use the ILG production environment, because the admin user account data is setup with users that are not available on ILG staging.

Please circulate any questions or concerns, and we'll discuss next steps on the process during our call with Ketan Sondarva, Technical Project Manager at DevIT Ketan tomorrow.

Thanks,

Morgan

Comments & Events

Jitesh Dhuravala, DevIT
Hi Morgan Maguire, CEO Morgan ,

We have read above information and following question we have so can you please provide your feedback so we can proceed soon.

1, From Production, Tag Directory, Project and document and its data need to restore (preserve) in staging environment? 

2, From Staging, All Project and its data need to restore (preserve) in production environment? 

We need to do action to full fill above question, right?

Second, We have to take care when restoring data from one environment to another like, if we are restoring data (Tag directory, project and its data ) from production to staging and same Tag directory item name available in staging than what to do? we need to consider which data, production or staging?

Same as when we taking data ( Projects ) from staging to production and same project name exist in production than which data we need to consider, staging or production?

Let me know we have understood correctly or not if yes than please provide your feedback so we will start Merging content between two environment. 

Thanks,
Jitesh
Morgan Maguire, CEO
Hi Jitesh Dhuravala, DevIT Jitesh ,

Here is my suggestion for implementing above:
  1. Create backups of both www.islg and dev.ilg to ensure we can restore previous versions if we make a mistake.
  2. Migrate all the project data from dev.ilg and www.ilg. 
    1. When performing the migration, maintain any existing project data on www.ilg (i.e., we are adding data to www.ilg, not replacing the data on www.ilg)
  3. After the migration is performed, Katrina Law, Legal Content Specialist at Tologix Katrina  and I will review the data and confirm whether the migration was successful.
  4. Replace all the data on dev.ilg with the data from www.ilg.
This will achieve the result we need while minimizing the risk of attempting to merge data between the two environments.

Thanks,

Morgan
Jitesh Dhuravala, DevIT
Hi Morgan Maguire, CEO Morgan ,

We have merged Projects data from staging (dev.ilg) to production (www.ilg). Please check and provide your feedback.

Merging content task is in process but we need your input to check progress is going as per expected or not so we can complete task in time so please provide your input for projects data we have merged in production site is fine or not.

Thanks,
Jitesh
Morgan Maguire, CEO
Hi Jitesh Dhuravala, DevIT Jitesh ,

Further to my note in the relevant item on DevOps, my initial look at the www.ilg indicates that the content merge was a success.

Katrina Law, Legal Content Specialist at Tologix Katrina is going to perform her review of www.ilg to confirm (step #3 above), and then we'll move on to step #4.

Thanks,

Morgan
Katrina Law, Legal Content Specialist at Tologix
Hi Jitesh Dhuravala, DevIT Jitesh and Morgan Maguire, CEO Morgan ,

I've noticed a couple issues in the data transfer as listed below:

1) Missing projects on production site
The number of projects between the two cites do not much (not including the projects for testing purposes on the dev site)

Projects appearing on dev.ilg but not production: ON/0192-ON/0195, ON/0163, NS/0004, MD/0008, BC/0099, BC/0098, BC/0097

Project appearing only appearing on production: TX/0035 

2) Incorrect data + new field
  • "Public Partner(s) - SPV" is appearing only on the production site. I believe this field used to be on dev.ilg. 
  • As demonstrated below there is some incorrect data between the two sites

dev.ilg

To note, most of the inconsistencies seem to involve data that has been added or modified within the last 6 months. Additionally, I haven't had a chance to check all the data, so this is only what I've observed so far. 

Thanks,

Katrina
Morgan Maguire, CEO
Hi Jitesh Dhuravala, DevIT Jitesh ,

Following up on Katrina Law, Legal Content Specialist at Tologix Katrina 's comments, could you please investigate these issues and determine what occurred here. Note Katrina Law, Legal Content Specialist at Tologix Katrina did not check all the data on the system, she only spot checked certain project. Therefore, please ensure any solution applied will apply systemically to resolve issues with other projects not specifically identified by Katrina Law, Legal Content Specialist at Tologix Katrina above.

Thanks,

Morgan 
Jitesh Dhuravala, DevIT
Hi Morgan Maguire, CEO Morgan and Katrina Law, Legal Content Specialist at Tologix Katrina ,

We are doing correction of data but please consider filed " Public Partner(s) - SPV" was deleted from dev.ilg so we can't migrate data of this field due to not available in staging (dev.ilg). 

Thanks,
Jitesh
Morgan Maguire, CEO
OK. Thanks Jitesh Dhuravala, DevIT Jitesh .

Katrina Law, Legal Content Specialist at Tologix Katrina and I discussed the issue with the Public Partner(s) - SPV field and we don't understand how this field and data was deleted from dev.ilg, because this data was not available on www.ilg, so it must have come from dev.ilg during the migration. Is there a way for you to look at the backup for dev.ilg and determine what happened here?

Thanks,

Morgan
Jitesh Dhuravala, DevIT
Hi Morgan Maguire, CEO Morgan and Katrina Law, Legal Content Specialist at Tologix Katrina ,

I have sent request to Carbon60 for past database backup so that we can recover deleted field from there but unfortunately they can only provide backup file from last 4 days and it will not resolve our issue because that field was delete in month of February so please provide your feedback what next we can do? As per next step, can we do all data restore from production to staging?

Thanks,
Jitesh
Morgan Maguire, CEO
Hi Jitesh Dhuravala, DevIT Jitesh ​,

Did we not create our own backup before performing the merger? That was the first step I outlined above.

If not, could you please provide us with an export of all the project data on www.ilg and we'll perform an audit on what data is missing with our offline spreadsheets.

Morgan
Jitesh Dhuravala, DevIT
Hi Morgan Maguire, CEO Morgan ,

We can take backup and we have already taken backup before performing the Merging task. But I'm talking about a February database backup if Carbon60 takes over regularly so we can get a deleted field that's missing on www.ilg after merging from Staging.


Yes, We can provide all project data on www.ilg in spreadsheet and you can identify missing data.

Thanks,
Jitesh
Morgan Maguire, CEO
Hi Jitesh Dhuravala, DevIT Jitesh ,

I understand. I didn't realize we were going back that far.

Ok. When you provide us with the project data, Katrina Law, Legal Content Specialist at Tologix Katrina and I will go through, compare it against our offline master list to confirm what is currently missing in the data and then decide on next steps.

Thanks,

Morgan
Morgan Maguire, CEO
Great. Thanks Jitesh Dhuravala, DevIT Jitesh .

Katrina Law, Legal Content Specialist at Tologix Katrina and I will review the project data and let you know if we find any issues that need to be resolved.

Thanks,

Morgan
Morgan Maguire, CEO
Hi Jitesh Dhuravala, DevIT Jitesh ,

Katrina Law, Legal Content Specialist at Tologix Katrina and I have confirmed that everything on www.ilg looks good.

Please proceed with step 4 above: replace all the data on dev.ilg with the data from www.ilg.

Thanks,

Morgan
Jitesh Dhuravala, DevIT
Hi Morgan Maguire, CEO Morgan ,

As per step 4, you need replace all the data on dev.ilg with the data from www.ilg. so can we ask same to Carbon60? because SQL database operation they will do properly as we have did earlier and sql database gone in offline mode might be there are permission to restore existing database. 

Let me know so I will arise ticket and inform to Carbon60 to do same.

Thanks,
Jitesh
Morgan Maguire, CEO
Hi Jitesh Dhuravala, DevIT Jitesh ,

Yes, we can replace all the data on dev.islg with the data on ww.ilg. Sure, if performing this task via Carbon60 is the most efficient way to implement the task, that's fine with me. Does that make sense to you Martin Laporte, CTO at Tologix Martin ?

Morgan
Jitesh Dhuravala, DevIT
Hi Martin Laporte, CTO at Tologix Martin ,

Are you going to inform to carbon60 for take database backup from production to restore database on staging?

Please let me know so we can do further step in this to do's.

Thanks,
Jitesh
Martin Laporte, CTO at Tologix
Hi Jitesh Dhuravala, DevIT Jitesh ,
Sorry, I missed the notification on the original @mention.

I'm good with this plan. Jitesh Dhuravala, DevIT Jitesh , can you open a ticket with Carbon60 and CC me? 

Thanks,
--Martin