Development/Projects/AABC Data Migration Toolkit/UNBC - Revision history

Dan: /* Extract */ Fix image tags

2015-07-31T22:06:01Z

‎Extract: Fix image tags

Dan: /* Restore UNBC MSSQL Backup */ fix image tag

2015-07-31T22:03:28Z

‎Restore UNBC MSSQL Backup: fix image tag

Dan: Add admonition

2015-07-31T21:58:53Z

Add admonition

Dan: /* Load digital objects */ Fix link

2015-07-31T00:10:34Z

‎Load digital objects: Fix link

Dan: /* Methodology */ Remove dead link

2015-07-31T00:08:36Z

‎Methodology: Remove dead link

Dan: /* Original sources for migration */ Fix spacing

2015-07-31T00:07:51Z

‎Original sources for migration: Fix spacing

Dan: /* Overview */ Fix another link

2015-07-31T00:06:41Z

‎Overview: Fix another link

Dan: /* Overview */ Fix links

2015-07-31T00:06:00Z

‎Overview: Fix links

Dan: /* Data not migrated */ fix link

2015-07-31T00:01:52Z

‎Data not migrated: fix link

Dan: Fix spacing and links, add navigation footer

2015-07-30T23:57:01Z

Fix spacing and links, add navigation footer

Show changes

@@ Line 115: / Line 115: @@
 === Create new SQL Server login ===
-[[File:MSSQL new login.png|thumb|Create SQL Server login]]
+[[File:MSSQL_new_login.png|thumb|center|400px|Create SQL Server login]]
 * In left pane of "Microsoft SQL Server Management Studio Express" click to expand "Security > Logins"
@@ Line 129: / Line 129: @@
 === Give read access to new login ===
-[[File:MSSQL user mapping.png|thumb|Give read access to new login]]
+[[File:MSSQL_user_mapping.png|thumb|center|400opx|Give read access to new login]]
 * Right-click newly created login, and select "Properties"
@@ Line 140: / Line 140: @@
 === Turn on TCP/IP access ===
-[[File:MSSQL configure TCPIP.png|thumb|Turn on TCP/IP access]]
+[[File:MSSQL_configure_TCPIP.png|thumb|center|400px|Turn on TCP/IP access]]
 * "Start > Microsoft SQL Server 2005 > Configuration Tools > SQL Server Configuration Manager"
@@ Line 161: / Line 161: @@
 == Connecting to MSSQL with PDI Spoon via JDBC ==
-[[File:Spoon jdbc connection MSSQL.png|thumb|PDI Spoon JDBC connection dialog]]
+[[File:Spoon_jdbc_connection_MSSQL.png|thumb|center|400px|PDI Spoon JDBC connection dialog]]
 '''PDI Spoon''' is a Java GUI for creating '''PDI''' Transformation scripts. We will use it to connect to MSSQL with the JDBC connector. Please read the [http://wiki.pentaho.com/display/EAI/Spoon+User+Guide Spoon documentation] for general instructions on using the tool.
@@ Line 171: / Line 171: @@
 * Click "Test"
 * Click OK
 <admonition type="note>
 '''NOTE:''' The "MS SQL Server (Native)" connector did not work in our tests, so the vanilla "MS SQL Server" connector was used
 </admonition>
 = Transform =

@@ Line 96: / Line 96: @@
 == Restore UNBC MSSQL Backup ==
-[[File:MSSQL restore database.png|thumb|Restore database dialog]]
+[[File:MSSQL_restore_database.png|thumb|center|400px|Restore database dialog]]
 * Download and install [http://www.microsoft.com/Sqlserver/2005/en/us/express-down.aspx SQL Server 2005 Express Edition with Advanced Services SP3 ]
@@ Line 110: / Line 110: @@
 * Click checkbox next to backup filename
 * OK
 == Setup MS SQL Server for remote connections ==

← Older revision		Revision as of 21:58, 31 July 2015
Line 1:		Line 1:
	{{#pagetitle:AABC Toolkit: UNBC data migration}}		{{#pagetitle:AABC Toolkit: UNBC data migration}}
	[[Main Page]] > [[Development]] > [[Development/Projects]] > [[Development/Projects/AABC Data Migration Toolkit]] > UNBC		[[Main Page]] > [[Development]] > [[Development/Projects]] > [[Development/Projects/AABC Data Migration Toolkit]] > UNBC
		+
		+	<admonition type="note">
		+	This is historical development documentation relating to the AABC Data Migration Toolkit project (2010-2011). It has been migrated here from a now-defunct wiki for reference. The content in this page was first created in December of 2010, and last updated March 23, 2011. This content was migrated to the AtoM wiki in July of 2015. Links have been updated where possible, and some presentation elements may have been to account for style differences between the two wikis. Otherwise, the content is the same. For more information, see the project landing page: [[Development/Projects/AABC Data Migration Toolkit\|AABC Data Migration Toolkit]].
		+	</admonition>
		+
		+

@@ Line 547: / Line 547: @@
 == Load digital objects ==
-Digital objects are loaded using the [[AABC_Data_Migration_Toolkit#Digital_object_load_task|digitalobject:load]] task using the [[#Digital assets|nbca_digitalobjects.csv]] file to link assets to archival descriptions.
+Digital objects are loaded using the [[Development/Projects/AABC Data Migration Toolkit#Digital_object_load_task|digitalobject:load]] task using the [[#Digital assets|nbca_digitalobjects.csv]] file to link assets to archival descriptions.
 = Post-processing =

@@ Line 76: / Line 76: @@
 = Methodology =
-# Migrate ICA-AtoM Release 1.0.9 data (with attached digital assets) to ICA-AtoM Release 1.1 data schema. See: [[qubit:Upgrading|Upgrading]]
+# Migrate ICA-AtoM Release 1.0.9 data (with attached digital assets) to ICA-AtoM Release 1.1 data schema.
 # Install MS SQL Server 2005 Express and load the ''NBCA'' database from backup file provided
 # Use the [http://wiki.pentaho.com/display/EAI/Spoon+User+Guide '''Pentaho Data Integration (PDI) Spoon'''] tool to create a data migration script to migrate the ''NBCA'' database to the ICA-AtoM data model
@@ Line 85: / Line 85: @@
 # Correct any problems with the migration script found in the data audit
 # Do the final migration of the data to the live UNBC site (hosted by Artefactual)
 = Extract =

@@ Line 16: / Line 16: @@
 == Original sources for migration ==
-One (1) MS SQL Server database backup file
+'''One (1) MS SQL Server database backup file'''
 # NBCA_backup_201004080030.bak
-Four (4) MS Access databases:
 # Fawcett.mdb
 # Ray Williston Collection.mdb
@@ Line 25: / Line 26: @@
 # Cassiar-Box751onwards.mdb
-One (1) archive (ZIP) file containing digital objects (image and video files):
 # Uploads.zip
 Data from one (1) ICA-AtoM Release 1.0.9 instance (set up in late 2010?), including description and digital assets
 # http://www.ica-atom.org/unbc
 == Data migrated ==

@@ Line 9: / Line 9: @@
 [http://library.unbc.ca/UNBCArchives/archDisplay/Default.aspx UNBC Archives] is the first participant to be migrated as part of the [[Development/Projects/AABC_Data_Migration_Toolkit|AABC Data Migration Toolkit]] project.  The original project specification included migrating data from MS SQL Server, MS Access and ICA-AtoM (Release 1.0.9) MySQL databases as well as linking over 5,000 digital asset files (image and video).
-Data migration from the MS SQL Server data was performed via the [http://wiki.pentaho.com/display/EAI/Spoon+User+Guide '''Pentaho Data Integration (PDI) Spoon'''] (pictured) extract, transform, load tool - see [[AABC_Data_Migration_Toolkit#Technical_Tool_Options|Technical Tool Options]] for other options considered, and reasons for selecting '''PDI'''.
+Data migration from the MS SQL Server data was performed via the [http://wiki.pentaho.com/display/EAI/Spoon+User+Guide '''Pentaho Data Integration (PDI) Spoon'''] (pictured) extract, transform, load tool - see [[Development/Projects/AABC_Data_Migration_Toolkit#Technical_Tool_Options|Technical Tool Options]] for other options considered, and reasons for selecting '''PDI'''.
 Due to the pilot nature of the project, there were a number of unforeseen technical challenges and the project ran over schedule.

@@ Line 7: / Line 7: @@
 [[File:Pdi nbca transform final.png|thumb|none|800px|Screenshot of final NBCA -> ICA-AtoM '''PDI Spoon''' migration job]]
-[http://library.unbc.ca/UNBCArchives/archDisplay/Default.aspx UNBC Archives] is the first participant to be migrated as part of the [[AABC Data Migration Toolkit]] project.  The original project specification included migrating data from MS SQL Server, MS Access and ICA-AtoM (Release 1.0.9) MySQL databases as well as linking over 5,000 digital asset files (image and video).
+[http://library.unbc.ca/UNBCArchives/archDisplay/Default.aspx UNBC Archives] is the first participant to be migrated as part of the [[Development/Projects/AABC_Data_Migration_Toolkit|AABC Data Migration Toolkit]] project.  The original project specification included migrating data from MS SQL Server, MS Access and ICA-AtoM (Release 1.0.9) MySQL databases as well as linking over 5,000 digital asset files (image and video).
 Data migration from the MS SQL Server data was performed via the [http://wiki.pentaho.com/display/EAI/Spoon+User+Guide '''Pentaho Data Integration (PDI) Spoon'''] (pictured) extract, transform, load tool - see [[AABC_Data_Migration_Toolkit#Technical_Tool_Options|Technical Tool Options]] for other options considered, and reasons for selecting '''PDI'''.
@@ Line 68: / Line 68: @@
 == Project deliverables ==
-# Migration of all source data to a single [http://www.ica-atom.org ICA-AtoM] [[ica-atom:Release_1.1|Release 1.1]] website (hosted by Artefactual)
+# Migration of all source data to a single [[Releases/Release announcements/Release 1.1|ICA-AtoM Release 1.1]]  website (hosted by Artefactual)
 # Integration of linked digital assets
 # This process documentation
 = Methodology =

@@ Line 47: / Line 47: @@
 * the Cassiar fonds files (''Cassiar_Box1_on.mdb'', ''Cassiar-Box751onwards.mdb'') were never scheduled for migration
 * in the course of the project it was determined that the "Ray Williston Collection" data was present in the NBCA (MS SQL Server) database, so migration of the ''Ray Williston Collection.mdb'' database was not necessary
-* The ''Fawcett.mdb'' database will be migrated after development of a [[AABC_Data_Migration_Toolkit#CSV Import]] methodology
+* The ''Fawcett.mdb'' database will be migrated after development of a [[Development/Projects/AABC_Data_Migration_Toolkit#2._Migration_using_CSV_import|CSV import]] methodology
@@ Line 65: / Line 65: @@
 # ''SpecifiedLocation'' - locations are specified at the Fonds level, and are very general (e.g. "Photograph room", "Mobile shelving", "On display in library").  UNBC agreed that migrating this data was not necessary.
 # ''Lookup'' - contained controlled vocabulary maintained in the ''Lookups'' table was not applicable in the ICA-AtoM application.
 == Project deliverables ==