Perl Import_Spells.pl

Krugus · #1 06-20-2009, 01:18 AM

Ok after reading up on everything, I'm trying to import SoF spells_us.txt file Deleted the Spells_New table. Sourced in the 230_spells_table.sql then ran perl import_spells.pl and I get a grand total of 28 spells in the db and a ton of errors in the cmd screen like the following:

Quote:

Error loading "Corruption DoT Bonus 5" (15925)
DBD::mysql::db do failed: Incorrect integer value: '' for column 'aoerange' at r
ow 1 at import_spells.pl line 115, <SPELLS> line 14797.
Error loading "Corruption DoT Bonus 7" (15926)
DBD::mysql::db do failed: Incorrect integer value: '' for column 'aoerange' at r
ow 1 at import_spells.pl line 115, <SPELLS> line 14798.
Error loading "Corruption DoT Bonus 9" (15927)
DBD::mysql::db do failed: Incorrect integer value: '' for column 'aoerange' at r
ow 1 at import_spells.pl line 115, <SPELLS> line 14799.
Error loading "Place Banner" (1592

Spells Loaded: 28 of 14799
Highest ID: 15928

Using SoF client
spells_us.txt from the SoF Client
sourced in the 230_spells_table.sql
copy the import_spells.pl from a fresh download of the Trunk
perl import_spells.pl and get the above errors (more than it listed of course)

Import_spells working for SoF spells_us.txt ? or am I missing something that if it was a snake it would have bit me twice?

I even sourced in a fresh DB and copied the Structure only from it to my DB and still get the same errors as I did when I sourced in the 230_spells_table.sql.

**AndMetal** · #2 06-20-2009, 01:36 AM

Code:

Error loading "Corruption DoT Bonus 5" (15925)
DBD::mysql::db do failed: Incorrect integer value: '' for column 'aoerange' at r
ow 1 at import_spells.pl line 115, <SPELLS> line 14797.
Error loading "Corruption DoT Bonus 7" (15926)
DBD::mysql::db do failed: Incorrect integer value: '' for column 'aoerange' at r
ow 1 at import_spells.pl line 115, <SPELLS> line 14798.
Error loading "Corruption DoT Bonus 9" (15927)
DBD::mysql::db do failed: Incorrect integer value: '' for column 'aoerange' at r
ow 1 at import_spells.pl line 115, <SPELLS> line 14799.
Error loading "Place Banner" (1592
Spells Loaded: 28 of 14799
Highest ID: 15928

From /trunk/EQEmuServer/utils/sql/svn/230_spells_table.sql:

Code:

`aoerange` int(11) NOT NULL default '0'

It appears it's pulling a null value for that field in your spells file. Easiest thing to do would be to change that column in the database to allow null values.

Krugus · #3 06-20-2009, 08:39 AM

Started anew.

Pulled the spells.us.txt from a fresh install of the SoF Client

Had to modify the 230_spells_table.sql to allow the following to be NULL before it would source in via import_spells.pl would get no errors.

range
aoerange
pushback
pushup
cast_time
recovery_time
recast_time
buffduration
mana
effect_base_value2
effect_base_value5
effect_limit_value5
max1
max2
formula2
formula3
formula4
Activated
resisttype
targettype
CastingAnin
TargetAnin
field124
newicon
ResistDiff
typedescnum
effectdescnum
field158
field160
field161
EndurTimerIndex
field175
spell_category
field182
field183
field209
field210

Using Rev669 from Trunk with no modifications (I have two folders, one I modify the other is clean from trunk with no modifications).

Zone.exe crashes when I try to get past character select.

Hrrmmm back to drawing board to see what the heck is going on.

Krugus · #4 06-20-2009, 12:59 PM

Restored Database to 61209 then downloaded Trunk Rev 656. Compile it with no personal mods.

Everything works fine.

update to Trunk Rev 664.

Compile got error. Fixed client_packet.cpp and recompiled.

Start up and zone crashes over and over (bad spell data in db)

Change spdat.h to load from spells.us.txt instead of using the new database method then recompiled. (fixed the zone crashing at start up)

Works fine.

Will see if I can get import_spells to work again with the SoF spells.us.txt file. From what I am getting so far it seems its not compatible (either that or I have flying monkeys on my WinXP pro box causing havoic with my spell import :/ )

Reading the change log and doing what it tells me to do... it seems busted to me (blasted flying monkeys)

Krugus · #5 06-20-2009, 01:56 PM

What I had to do to get import_spells.pl to work on the SoF spells.us.txt file.
I changed the following fields in 230_spells_table.sql from int(11) NOT NULL to varchar(64).

range
aoerange
pushback
pushup
cast_time
recovery_time
recast_time
buffduration
mana
effect_base_value2
effect_base_value5
effect_limit_value5
max1
max2
formula2
formula3
formula4
Activated
resisttype
targettype
CastingAnin
TargetAnin
field124
newicon
ResistDiff
typedescnum
effectdescnum
field158
field160
field161
EndurTimerIndex
field175
spell_category
field182
field183
field209
field210

Sourced in all the spells (14799 of 14799).
Changed the spdat.h file to load from the DB instead of spells.us.txt file.
Removed spells.us.txt file from eqemu folder.

Started up the server.

Zone didn't crash on start up. Loaded into West Commons and casted a few spells, no crash. Not sure if everything is 100% but will keep testing......

Anyways, the 230_spells_table.sql needs to be adjusted to work with SoF spells.us.txt or it wont import via import_spells.pl

Is it just me or did anyone else have this problem? LOL

Krugus · #6 06-29-2009, 12:58 PM

Ok been doing some more research on this issue.

I'm using MySQL 5.0.77

From what I have read that in MySQL 4 and prior, if a column is set to ' ', it was just converted to a zero value but in MySQL 5 it will spit out the error "Incorrect integer value".

Further reading into this matter suggests its a sql_mode issue. It is suggested to get the old MySQL 4 behaviour back that one should execute set sql_mode = ' '; which they said an empty string means Traditional MySQL mode.

(if I'm wrong guys feel free to correct me at anytime!

)

Since the default value is empty (no modes set) and that is what set sql_mode = ' ' does.... I cleared my SQL Mode, left it empty. This setting is in your my.ini file (for those like me that didn't know :p ). There are a few different ways to access it. Directly by just finding your my.ini file and clear the SQL MODE... another way is to load up MySQL Administrator and goto Startup Variables, Click on Advanced Tab then slide about midway down in the Various box you you will find SQL Mode: You can clear it here as well.

Now after clearing this. I deleted my spells_new table. Sourced in the 230_spells_table.sql unmodified. Ran Perl import_spells.pl and it reported no errors and I had a full listing of spells (14799 of 14799).

So it was me all this time! Gah. What got me to do further research was when I tried to update my PEQ DB editor and the isbot filed spit out the error "Incorrect integer value". I looked on the boards, found no one else having this problem so off to Google I went. A few seconds later I found what my problem was. Sheesh.

So the moral of the story...... Search the Boards, Google it and do some research.

Anyways, just thought I would share

Randymarsh9 · #7 07-12-2009, 06:51 PM

I am having trouble with this script. When I double click it, it just immediately closes and when I run it from a command prompt I get this

Code:

install_driver(mysql) failed: Can't locate DBD/mysql.pm in @INC (@INC contains:
C:/Perl/site/lib C:/Perl/lib .) at (eval 4) line 3, <F> line 38.
Perhaps the DBD::mysql perl module hasn't been fully installed,
or perhaps the capitalisation of 'mysql' isn't right.
Available drivers: CSV, DBM, ExampleP, File, Gofer, ODBC, Oracle, Proxy, SQLite,
 Sponge.
 at import_spells.pl line 61

**GeorgeS** · #8 07-13-2009, 10:23 AM

That just reminds me to finish a new spell file importer...
I think many would benefit from this.

GeorgeS

**trevius** · #9 07-13-2009, 07:29 PM

Yeah, that would definitely be a handy tool to have. It would also be really nice to have a tool similar to the Ailia/Bleh spell editor for editing the spells table vs just being able to edit the spells file. I briefly spoke with Ailia about this recently and she said that there is a possibility that she will update the spells editor and share it with the community, but that it depends on how busy she is with other things and a few other factors. It would be really great to have a good spells tool that worked so well on the table.

GeorgeS, if/when you make the import tool, can you add in the option to export as well. Since a customized spell table means clients may need to use a custom spell file, it is good to have a simple way to export the file from the table as well. The scripts are actually fairly simple to run, but for people that aren't familiar with it, I can see how it might be tough to figure out. Plus, it will overwrite stuff without asking, so it might be nice to give a warning before overwriting any existing table/file or maybe an option to rename them before importing/exporting something that would overwrite existing data.

**GeorgeS** · #10 07-14-2009, 01:52 AM

Working on the tool now.

I'm about 1/2 done, and probably might be done in two days or so.

It will load and export.

GeorgeS

..can someone point me to this .pl file please?

Shendare · #11 07-14-2009, 10:27 AM

I believe it's this one:

http://code.google.com/p/projecteqem...port_spells.pl

**GeorgeS** · #12 07-15-2009, 02:27 AM

Ok, after some effort, I have it done

If you have trouble getting the perl program to work, this tool is for you!

spells_us.txt import/export ver 1.0.0
-- This tool allows one to import the SOF spells file and export.
-- Place your SOF spells_us.txt file in the main program folder.
-- The exported file is named spells_us_COPY.txt.

Non SOF files are not supported/will not work.

file is found on my site.. (if the .zip won't open, rename it to .rar)

Please report any bugs here

GeorgeS

ChaosSlayerZ · #13 07-15-2009, 02:34 AM

is there a specific difference between T and Sof spell files, other than number of spells?

cuase all my custom spells are T based, you saying the program won't work for them?

**GeorgeS** · #14 07-15-2009, 02:42 AM

It's the number of fields and the field names in the spell table and if they line up or not is not tested. It's possible to add this in at some stage as a beta test

I would need a table struct/schema of your spell table with a few sample spells, then I can add this in.

Fear not, I just don't have non SOF spell tables, and providing me with them - I can add non SOF support.

*edit*
I looked at the Titanium spell file, and it looks like it lines up with SOF, but with 15 or so fewer fields, so I will code up Titanium next.

GeorgeS

Yeormom · #15 07-15-2009, 12:05 PM

I gave it a try but all it did was run at 100% thread processor usage for 2 hours before I killed the process tree. Never saw an interface of any type, if there is one.