EqWorldConverter1.0 (converts myseq data to mysql source)

[Armanthuz]

Well i got bored.....


What this script does is take a text dump from myseq and convert it into mysql sourceable file.

Hats off to myseq@yahoo.com for helping me get a bug fixed in myseq and adding the heading feature to text dump on very short notice... THANKS!



What you need are...

MySeq which can be downloaded from...

http://www.dvolve.net/EQ/MySEQ/


And you can read about it here...

http://seq.sourceforge.net/forums/forumdisplay.php?s=&forumid=60

ATTENTION!!- Almost every time liveeq patches you will have to change a few settings in myseq for it too work properly.


Youll also need to get and install perl from here....

http://www.perl.com/pub/a/language/info/software.html



Then you need the script from here...

http://www.geocities.com/rlh989/downloads.htm


Install perl, unzip myseq into its own folder, then install eqworldconverter into its own folder also...


Then you start the server module of myseq, log into eqlive, then start client portion of myseq.... Click GO button, and pick save mobs and it will dump a text file to client dir named by the date/time..

(for best results turn off all options but NPCs that myseq scans for)


Now you have a snapshot of all the mobs ina zone, with info.... Copy this text file to you eqworldconverter directory and name it whatever you want.

Open a command prompt and navigate to directory you have eqworldconverter in, and type 'perl eqworldconverter.prl;'

This will start the script it will then ask you for name of file you are converting..... (the text file from myseq) and then it will ask you for the starting number of db.... This means it is asking you for a row number in npc_types AFTER your existing data. Once it has that data it adds 20000 to number for purposes of filling in spawn tables and such.

The output is a *.sql file that you should be able to source directly into you existing database provided you set it up right from above.


This is still in beta phase, you can COUNT on having to run through the *.sql file after words and picking out a few errors here and there because i cant anticipate everything.

I took educated guesses on formulas for setting mobs hp, min dmg max dmg and so on, this WILL change over time most likely...

All i ask is that you SHARE the material you make successfully with this so everyone has a populated server to play on!


*edit*

What this file will convert directly from myseq data...

Name
Class
Race
Level
XYZ coords
Heading of MOB

I take guessimation shots at..

HP
min/max dmg
gender
spellcasting abilities


What i cant get or guess at yet( and this may be possible in near future)..

Size of MOB
Texture
Helm texture
Faction
hp and mana regen


Also some race models are either missing (very few) or everquest has changed the name of them since they have been listed here. If you find a mob that wont go through please find its name/zone/ and rough position and ill work it out...








*disclaimer - yes i am new to perl and it will show in the code, consider this a starting point from which we can build on.*

[arkaria]

Props to ya if this works

[Armanthuz]

Proof of concept anyhow... Took me about 30 mins from start to finish to take snapshot, convert it, pick out literally 3-4 lines, and sourced it into my server and ran through it....


http://www.strike9.com/comments.aspx?fileid=354396&path=/rlh989/fullsize/planeofstorms.sql


This was on 5.2dr1 server, but i also tested it on 5.1 servers too, seems fine...

[Trumpcard]

Thats just pretty darn cool !

[Conan]

I have tested this and it seems to work. Few bugs need to be worked out though

ERROR 1064: You have an error in your SQL syntax near 'Guard,1,0,5440,2,0,0,0,2,
0,0,0,0,0,93,185,'',0,65,0,0,0,0,0,0,0,0,0,250,250 ,25,2' at line 2
ERROR 1054: Unknown column '126i' in 'field list'
ERROR 1064: You have an error in your SQL syntax near 'Guard,1,0,5440,2,0,0,0,2,
0,0,0,0,0,93,185,'',0,65,0,0,0,0,0,0,0,0,0,250,250 ,25,2' at line 2
ERROR 1064: You have an error in your SQL syntax near 'Guard,1,0,5200,2,0,0,0,2,
0,0,0,0,0,89,177,'',0,65,0,0,0,0,0,0,0,0,0,250,250 ,25,2' at line 2
ERROR 1064: You have an error in your SQL syntax near 'Guard,1,0,5200,2,0,0,0,2,
0,0,0,0,0,89,177,'',0,65,0,0,0,0,0,0,0,0,0,250,250 ,25,2' at line 2
ERROR 1064: You have an error in your SQL syntax near 'Guard,1,0,5200,2,0,0,0,2,
0,0,0,0,0,89,177,'',0,65,0,0,0,0,0,0,0,0,0,250,250 ,25,2' at line 2
ERROR 1054: Unknown column '126i' in 'field list'
ERROR 1064: You have an error in your SQL syntax near 'Guard,1,0,5200,2,0,0,0,2,
0,0,0,0,0,89,177,'',0,65,0,0,0,0,0,0,0,0,0,250,250 ,25,2' at line 2

Seems the Guard is the error in this case =)

INSERT INTO npc_types VALUES
(12366,'a_doomfire_guardian25',68,58 Guard,1,0,5440,2,0,0,0,2,0,0,0,0,0,93,185,'',0,65, 0,0,0,0,0,0,0,0,0,250,250,25,25,25,25,25,0);

Also I got the files yesturday so they are outdated, let me try the new files and see if I get the same error

Can be found in Plane of fire

[Armanthuz]

redownload the latest script, i added some text that in effect replaces any corpse or player with the term "BOGUS ENTRY" which when you attempt to source it, will be refused by msql. This effectively strips out corpses and players that were taken in snapshot...


a new version of MYSEQ came out this weekend, i am in middle of testing, but at first glance it appears that everything is fine atm if you use the NEW SCRIPT.


Changes to the script and download links were done monday morning by me, so if you got stuff before that redownload BOTH myseq 1.15.13 client and script please

[Shredomatic]

If this works well I'd be tempted to renew live for a month to collect data. :)

[Armanthuz]

The one problem that will crop up with script is that even thou i used an extensive model conversion chart, i still am missing some race numbers for certain models. If you notice problems, try to note what MOB it was and where it can be found and ill try to add it too script.


I hope to have some more realistic HP formulas worked out by this upcoming weekend, and more minor tweaks....


Any feedback or suggestions for features is fine...

[Trumpcard]

Love it... Very cool utility...

You should organize data gatherers to and release a series of zone upgrade .sql files once you get it tweaked to your hearts content...

[Conan]

I plan on doing that trump as soon as the bugs are worked out =)

Also in the lastes zip for worldconverter there are 2 pl files do we still use the same one listed above?

[Armanthuz]

Zip file fixed, only one in there now, my bad...

Plane of Fire bug fixed for solusek ro guardian...

Fixed several more text conversion bugs..

When its a monster gender is set to neutral, when its a playable race its set to male for now ( dont get this info in snapshot yet)

New Zip uploaded 7:40 pm CST

[fanoen]

U say go to directory and type in perl eqworldconvert.prl;
Well it says perl isnt reconized as a command...

[Armanthuz]

Did you install perl, and is perl package in your path?

[Conan]

That is because in his new zip the name is different =) Well that is what I noticed anyways.

Try using pearlconverter.prl

[Armanthuz]

:P

I double checked this morning, script is named Eqworldconverter.prl.. there was a typo in directions, i corrected that....


Trying to do bug fixes and corrections in between work and school :)

[fanoen]

found it, downloaded the wrong one lol.

[Conan]

Looking forwards to some more updates. Tonight or tomarrow i will trying to generate

Pofire, Poair, Powater, Poearth A, Potorment, Potatics, Solro Tower,
Hoha, Hohb and potranquil =) so I might have some bugs if any for ya.

Conan

[Armanthuz]

Great,

In the future * i dont know at all when * there will be some more features added to myseq. The guy that programs it is just great, hes been accessable, fun to talk too, and is really enthusiastic about adding things to his code that will help eqemu out...


Most of what hes adding to snapshot data we will have should clear up quite a few areas that ive had to guess on.


I plan working out better hp formula this weekend, and commenting out script better so people can emss with it easier..

[fanoen]

Ok i source it and some zones dont have the mobs up. but in fqadmin the mobs are there.

[Conan]

I had no problems sourceing in mine. Must be something that you are doing.

[cybermax]

This seems very kewl indeed.. Ill see if i can take a look at it..

At the moment i am using "Myradb" wich has a lot of zones spawned, but not the PoP zones. So.. if anyone got a crude pop zone populate DB, you think it would be possible to post it somewhere?

[Conan]

I am currently setting up spawns for pop on my server. Makeing them extra hard though because mine is semi legit. =)

[cybermax]

Tried the script just now.. Got some error about "Error 1064: You have an error in your SQL syntax..."

And a helluva lot of "Error 1136: Column count doesn't match value count at row 1"..

I am using 0.5.2 database (Myradb).

Any updates? Table structure changes perhaps, so the script needs to be updated?

[Conan]

I am not sure where you are getting the errors, I am useing tcs latest database and there are a few problems for example some of the models are entered with a name instead of a value make sure you take a look at these. Which zone are you trying to do and I can take a look at the zone?

[cybermax]

I am in no way so familiar with the table structure that i can change whatever.. hehe..

Oki.. example.. this is from MySEQ :

Muzzrap_Dirtdigger00 70 Warrior Gnome Humanoid Visible 0 75 2226 -1362 -715,75 260,1563

Now.. this will turn in to the 4 lines here :

INSERT INTO npc_types VALUES (190001,'Muzzrap_Dirtdigger00',70,12,1,0,5600,0,0, 0,0,2,0,0,0,0,0,96,191,'',0,65,0,0,0,0,0,0,0,0,0,2 50,250,25,25,25,25,25,0);
INSERT INTO spawn2 VALUES (210001,210001,'potranquility',2226,-1362,-715,260,600,1,0,0);
INSERT INTO spawnentry VALUES (210001,190001,1);
INSERT INTO spawngroup VALUES (210001,'spawn210001');

And this resulting in the "npc_types" "Error 1136: Column count does... blablabla"

The other 3 lines parse just fine.

So.. any hint what is missing or not in the npc_types?

Btw.. i am using MyraDB atm.

An example of how a similar line looks in that DB is here :
INSERT INTO npc_types VALUES (1,'Aagron',NULL,35,1,1,1,2010,0,3,3,0,0,6,5,0,0,1 ,14,73,'',0,65,1,6,0,0,0,0,0,0,0,250,250,18,18,18, 18,18,0);

Well.. a bone to chew on.. cos i am too much of a n00b to figure that out :P

[Trumpcard]

log into your mysql.

Type 'use eq';
Type 'describe npc_types';

Look at the column list, match it up to your insert, figure out what youre missing and add it.

[cybermax]

Thankies :) MyraDB did not use the same structure as TCS, so i guess there is where the culprit lies :)

[Scorpious2k]

MyraDB uses the latest db.sql format.

One thing I see you're missing is lastname.

[cybermax]

Yeah.. the script is prolly not updated to the latest structure me thinks..

[Armanthuz]

New script is up... should be compatible with 5.2 release DB


If you want to use with tcs DB or older DB, just edit script with notepad and look down about 1/3 way through script and remove the word NULL, and the comma to the RIGHT of it.

Save it and should be ready


New Things in latest script are..

Weeds out invisible trigger spots, teleport pads, and stuff like that cause otherwise they show up as humans in world.

Improved weeding out of corpses, players

Corrected a handful of translation errors



i have NOT had time to FULLY test this yet, but it seems to translate scripts pretty well that i can see by eye, ill try to load up 5.2 db table this week and play with it some. Plz let me know if theres problems.