Analysing WikiPedia dump file.....

14 May 2006 2:43 PM

Lloyd Dupont

I just download wikipedia's wikibooks dump file.
http://download.wikimedia.org/
I have a hard time figuring out what to do with 130MB XML file.
I tried hard to convert it to to a MySQL database with xml2sql but grr...
mysqlimport keeps failing with column id invalid...

How could I use the damn thing!
130MB of XML! Most of my text editor / viewer just fail...

14 May 2006 4:04 PM

Mehdi

On Mon, 15 May 2006 00:43:57 +1000, Lloyd Dupont wrote:

> I just download wikipedia's wikibooks dump file.
> http://download.wikimedia.org/
> I have a hard time figuring out what to do with 130MB XML file.
> I tried hard to convert it to to a MySQL database with xml2sql but grr...
> mysqlimport keeps failing with column id invalid...
>
> How could I use the damn thing!
> 130MB of XML! Most of my text editor / viewer just fail...

There's documentation on their download page about the format they are
using and tools that can be used to import the dumps in a database. Have
you tried them?

15 May 2006 12:24 AM

Lloyd Dupont

As I sai I tryed mysqlimport on the SQL file create by xml2sql from the big
xml.
but I keep having SQL error (invalid value for column)

--
Regards,
Lloyd Dupont

NovaMind development team
NovaMind Software
Mind Mapping Software
<www.nova-mind.com>

Show quoteHide quote

"Mehdi" <vio***@REMOVEME.gmail.com> wrote in message
news:1qxrwp9imhclr$.1ckdqlerj3ve4$.dlg@40tude.net...
> On Mon, 15 May 2006 00:43:57 +1000, Lloyd Dupont wrote:
>
>> I just download wikipedia's wikibooks dump file.
>> http://download.wikimedia.org/
>> I have a hard time figuring out what to do with 130MB XML file.
>> I tried hard to convert it to to a MySQL database with xml2sql but grr...
>> mysqlimport keeps failing with column id invalid...
>>
>> How could I use the damn thing!
>> 130MB of XML! Most of my text editor / viewer just fail...
>
> There's documentation on their download page about the format they are
> using and tools that can be used to import the dumps in a database. Have
> you tried them?

16 May 2006 9:14 PM

Marcus Kwok

In microsoft.public.dotnet.languages.vc Lloyd Dupont <net.galador@ld> wrote:

> As I sai I tryed mysqlimport on the SQL file create by xml2sql from the big
> xml.
> but I keep having SQL error (invalid value for column)

But did you try the tools they give you? Specifically, mwdumper.
http://meta.wikimedia.org/wiki/Data_dumps

--
Marcus Kwok
Replace 'invalid' with 'net' to reply