On migration from eXist-1.0b2-build-1107 to eXist-snapshot-20050805

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

On migration from eXist-1.0b2-build-1107 to eXist-snapshot-20050805

Øyvind Vestavik

Hi everybody

This is probably something stupid alltogether but I can't seem to migrate
my data from eXist-1.0b2-build-1107 to eXist-snapshot-20050805

What I did was to move my the data dir out of the eXist-1.0b2-build-1107
catalogue and install the eXist-snapshot-20050805 as recommended on the download page.
I modified the config.xml of the snapshot to read:

         <db-connection database="native" files="/home/oyvindve/Documents/forskningsrelatert/datagrunnlag/eXistData"
                 pageSize="4096" cacheSize="48M" free_mem_min="5">

The only change here to the "default"/original entry in config.xml should
be the path to the data catalogue which holds the following files:

-rw-r--r--  1 root root  36K 2005-10-03 13:31 collections.dbx
-rw-r--r--  1 root root 743M 2005-10-03 13:31 dom.dbx
-rw-r--r--  1 root root 196M 2005-10-03 13:31 elements.dbx
-rw-r--r--  1 root root   69 2005-09-30 13:42 README
-rw-r--r--  1 root root 2.9K 2005-09-30 13:42 symbols.dbx
-rw-r--r--  1 root root 266M 2005-10-03 13:31 words.dbx

When I startup eXist-1.0b2-build-1107 (startup.sh and server.sh) this
directory is read fine, but with eXist-snapshot-20050805 i get an
ArrayOutOfBoundsException. I also get

03 Oct 2005 13:55:01,136 [main] DEBUG (NativeBroker.java [<init>]:246) -
failed to initialize database: Error opening elements.dbx
org.exist.storage.btree.DBException: Error opening elements.dbx

Should it be possible to migrate the data, and if so, what do I have to
migrate my data? I see the snapshot has additional files in its
data directory.

I could reload the data in a batch, but that takes app. 6
hours using xmlrpc with current memory settings.

The full readout of startup.sh is given below.

kind regards
Øyvind Vestavik


root@oyvindve1:/usr/local/eXist/eXist-snapshot-20050805/bin# ./startup.sh
Configuring eXist from /usr/local/eXist/eXist-snapshot-20050805/conf.xml
03 Oct 2005 14:03:31,751 [main] DEBUG (IndexSpec.java [read]:92) - Reading
configuration ...
Loading catalog:
/usr/local/eXist/eXist-snapshot-20050805/webapp/WEB-INF/catalog
03 Oct 2005 14:03:31,788 [main] INFO  (Configuration.java
[configureBackend]:310) - data directory =
/home/oyvindve/Documents/forskningsrelatert/datagrunnlag/eXistData
03 Oct 2005 14:03:31,790 [main] DEBUG (BrokerPool.java [configure]:116) -
configuring database instance 'exist' ...
03 Oct 2005 14:03:31,799 [main] INFO  (BrokerPool.java [<init>]:323) -
Max. wait during shutdown: 120000
03 Oct 2005 14:03:31,800 [main] INFO  (BrokerPool.java [<init>]:325) -
Instances: min = 1; max = 20; sync = 120000
03 Oct 2005 14:03:31,810 [main] DEBUG (BrokerPool.java [initialize]:544) -
initializing database exist
03 Oct 2005 14:03:31,815 [main] INFO  (CacheManager.java [<init>]:103) -
Cache settings: totalPages: 12288; maxCacheSize: 9216
03 Oct 2005 14:03:31,823 [main] INFO  (XQueryPool.java [<init>]:93) -
QueryPool: maxStackSize = 5; timeout = 120000; timeoutCheckInterval =
30000
03 Oct 2005 14:03:31,853 [main] DEBUG (Journal.java [<init>]:140) -
SyncOnCommit = false
03 Oct 2005 14:03:31,855 [main] DEBUG (Journal.java [<init>]:167) - Using
directory for the journal:
/usr/local/eXist/eXist-snapshot-20050805/webapp/WEB-INF/data
03 Oct 2005 14:03:31,951 [main] DEBUG (DBBroker.java [<init>]:166) -
Loading symbol table from
/home/oyvindve/Documents/forskningsrelatert/datagrunnlag/eXistData/symbols.dbx
03 Oct 2005 14:03:31,979 [main] DEBUG (DBBroker.java [<init>]:181) -
fragmentation = 20
03 Oct 2005 14:03:32,026 [main] DEBUG (NativeBroker.java [<init>]:196) -
Initializing broker 3916375
java.lang.ArrayIndexOutOfBoundsException: 4096
         at org.exist.util.ByteConversion.byteToInt(ByteConversion.java:36)
         at org.exist.storage.index.FreeList.read(FreeList.java:161)
         at org.exist.storage.index.BFile$BFileHeader.read(BFile.java:1480)
         at org.exist.storage.btree.Paged$FileHeader.read(Paged.java:653)
         at org.exist.storage.btree.Paged.open(Paged.java:308)
         at org.exist.storage.btree.BTree.open(BTree.java:173)
         at org.exist.storage.index.BFile.open(BFile.java:596)
         at org.exist.storage.index.BFile.<init>(BFile.java:151)
         at
org.exist.storage.NativeBroker.createValueIndexFile(NativeBroker.java:298)
         at
org.exist.storage.NativeBroker.createIndexFiles(NativeBroker.java:259)
         at org.exist.storage.NativeBroker.<init>(NativeBroker.java:211)
         at
org.exist.storage.BrokerFactory.getInstance(BrokerFactory.java:34)
         at org.exist.storage.BrokerPool.createBroker(BrokerPool.java:437)
         at org.exist.storage.BrokerPool.initialize(BrokerPool.java:566)
         at org.exist.storage.BrokerPool.<init>(BrokerPool.java:330)
         at org.exist.storage.BrokerPool.configure(BrokerPool.java:117)
         at org.exist.storage.BrokerPool.configure(BrokerPool.java:95)
         at org.exist.JettyStart.run(JettyStart.java:71)
         at org.exist.JettyStart.main(JettyStart.java:45)
         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
         at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
         at java.lang.reflect.Method.invoke(Method.java:585)
         at org.exist.start.Main.invokeMain(Main.java:119)
         at org.exist.start.Main.run(Main.java:375)
         at org.exist.start.Main.main(Main.java:48)
         at org.exist.start.Main.main(Main.java:48)
03 Oct 2005 14:03:32,142 [main] DEBUG (NativeBroker.java [<init>]:246) -
failed to initialize database: Error opening elements.dbx
org.exist.storage.btree.DBException: Error opening elements.dbx
         at org.exist.storage.btree.Paged.open(Paged.java:318)
         at org.exist.storage.btree.BTree.open(BTree.java:173)
         at org.exist.storage.index.BFile.open(BFile.java:596)
         at org.exist.storage.index.BFile.<init>(BFile.java:151)
         at
org.exist.storage.NativeBroker.createValueIndexFile(NativeBroker.java:298)
         at
org.exist.storage.NativeBroker.createIndexFiles(NativeBroker.java:259)
         at org.exist.storage.NativeBroker.<init>(NativeBroker.java:211)
         at
org.exist.storage.BrokerFactory.getInstance(BrokerFactory.java:34)
         at org.exist.storage.BrokerPool.createBroker(BrokerPool.java:437)
         at org.exist.storage.BrokerPool.initialize(BrokerPool.java:566)
         at org.exist.storage.BrokerPool.<init>(BrokerPool.java:330)
         at org.exist.storage.BrokerPool.configure(BrokerPool.java:117)
         at org.exist.storage.BrokerPool.configure(BrokerPool.java:95)
         at org.exist.JettyStart.run(JettyStart.java:71)
         at org.exist.JettyStart.main(JettyStart.java:45)
         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
         at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
         at java.lang.reflect.Method.invoke(Method.java:585)
         at org.exist.start.Main.invokeMain(Main.java:119)
         at org.exist.start.Main.run(Main.java:375)
         at org.exist.start.Main.main(Main.java:48)
configuration error: org.exist.storage.btree.DBException: Error opening
elements.dbx
org.exist.EXistException: org.exist.storage.btree.DBException: Error
opening elements.dbx
         at org.exist.storage.NativeBroker.<init>(NativeBroker.java:247)
         at
org.exist.storage.BrokerFactory.getInstance(BrokerFactory.java:34)
         at org.exist.storage.BrokerPool.createBroker(BrokerPool.java:437)
         at org.exist.storage.BrokerPool.initialize(BrokerPool.java:566)
         at org.exist.storage.BrokerPool.<init>(BrokerPool.java:330)
         at org.exist.storage.BrokerPool.configure(BrokerPool.java:117)
         at org.exist.storage.BrokerPool.configure(BrokerPool.java:95)
         at org.exist.JettyStart.run(JettyStart.java:71)
         at org.exist.JettyStart.main(JettyStart.java:45)
         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
         at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
         at java.lang.reflect.Method.invoke(Method.java:585)
         at org.exist.start.Main.invokeMain(Main.java:119)
         at org.exist.start.Main.run(Main.java:375)
         at org.exist.start.Main.main(Main.java:48)
Caused by: org.exist.storage.btree.DBException: Error opening elements.dbx
         at org.exist.storage.btree.Paged.open(Paged.java:318)
         at org.exist.storage.btree.BTree.open(BTree.java:173)
         at org.exist.storage.index.BFile.open(BFile.java:596)
         at org.exist.storage.index.BFile.<init>(BFile.java:151)
         at
org.exist.storage.NativeBroker.createValueIndexFile(NativeBroker.java:298)
         at
org.exist.storage.NativeBroker.createIndexFiles(NativeBroker.java:259)
         at org.exist.storage.NativeBroker.<init>(NativeBroker.java:211)
         ... 15 more
Reply | Threaded
Open this post in threaded view
|

Re: On migration from eXist-1.0b2-build-1107 to eXist-snapshot-20050805

Pierrick Brihaye-2
Hi,

Øyvind Vestavik wrote:

> This is probably something stupid alltogether but I can't seem to
> migrate my data from eXist-1.0b2-build-1107 to eXist-snapshot-20050805
>
> What I did was to move my the data dir out of the eXist-1.0b2-build-1107
> catalogue and install the eXist-snapshot-20050805 as recommended on the
> download page.
> I modified the config.xml of the snapshot to read:
>
>         <db-connection database="native"
> files="/home/oyvindve/Documents/forskningsrelatert/datagrunnlag/eXistData"
>                 pageSize="4096" cacheSize="48M" free_mem_min="5">
>
> The only change here to the "default"/original entry in config.xml
> should be the path to the data catalogue which holds the following files:
>
> -rw-r--r--  1 root root  36K 2005-10-03 13:31 collections.dbx
> -rw-r--r--  1 root root 743M 2005-10-03 13:31 dom.dbx
> -rw-r--r--  1 root root 196M 2005-10-03 13:31 elements.dbx
> -rw-r--r--  1 root root   69 2005-09-30 13:42 README
> -rw-r--r--  1 root root 2.9K 2005-09-30 13:42 symbols.dbx
> -rw-r--r--  1 root root 266M 2005-10-03 13:31 words.dbx
>
> When I startup eXist-1.0b2-build-1107 (startup.sh and server.sh) this
> directory is read fine, but with eXist-snapshot-20050805 i get an
> ArrayOutOfBoundsException.

When the internal binary format changes, you need to backup then restore
your data.

See http://exist.sourceforge.net/client.html#N10318
or use the interactiveClient

Cheers,

--
Pierrick Brihaye, informaticien
Service régional de l'Inventaire
DRAC Bretagne
mailto:[hidden email]
+33 (0)2 99 29 67 78


-------------------------------------------------------
This SF.Net email is sponsored by:
Power Architecture Resource Center: Free content, downloads, discussions,
and more. http://solutions.newsforge.com/ibmarch.tmpl
_______________________________________________
Exist-open mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/exist-open
Reply | Threaded
Open this post in threaded view
|

Re: On migration from eXist-1.0b2-build-1107 to eXist-snapshot-20050805

Wolfgang Meier-2
> When the internal binary format changes, you need to backup then restore
> your data.

Just a note: using the 20050805 snapshot, restoring from a backup is extremely
slow. I just fixed this yesterday. Also, the binary format will change again
for the next snapshot. It might thus be a good idea to get the CVS version
instead of going through that trouble twice.

Wolfgang


-------------------------------------------------------
This SF.Net email is sponsored by:
Power Architecture Resource Center: Free content, downloads, discussions,
and more. http://solutions.newsforge.com/ibmarch.tmpl
_______________________________________________
Exist-open mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/exist-open