something to get working

[norsan]

would anyone like to assist me in getting the items tables up to date with whats on eqitems.13th-floor.org it would be awesome if we could once again keep the items table up to date

[joligario]

Cavedude did a 13th floor dump not too long ago. His PEQ database is probably pretty up-to-date.

[norsan]

i use the peq db theres alot of items missing

[trevius]

PEQ DB can only update to what 13 floor has collected so far. I would say it probably has about 95% of all items available on Live atm. The missing ones are probably just the items that people haven't collected while running the 13 floor tools to log them yes. Are you finding a bunch missing stuff in the PEQ DB that you can actually find with a 13 floor website search? When was the last time you updated your items table to PEQ? The last time I did it, I just removed the part of the SQL that removes and rebuilds the table, so I didn't lose any existing items (custom or not) that I already had in my table. Then, I just made sure that the schema for my table matched the PEQ table perfectly. Once that was done, I just sourced in the SQL entries and allowed it to error for all existing items in my table. I hadn't updated in over a year, and this last time I got about 12k new items added, which was really nice. The updated items are great if you are using SoF on your server.

[laxative]

Hi,

I have futzed around with the items much at all. But I did notice that everytime I update the database I'm not seeing any new items.

I have 76214 items that load when I start the server. Does this information seem about right? I guess I need to do some reading regarding 13th floor.

Laxa

[joligario]

That number looks right.

[Andrew80k]

PEQ DB can only update to what 13 floor has collected so far. I would say it probably has about 95% of all items available on Live atm. The missing ones are probably just the items that people haven't collected while running the 13 floor tools to log them yes. Are you finding a bunch missing stuff in the PEQ DB that you can actually find with a 13 floor website search? When was the last time you updated your items table to PEQ? The last time I did it, I just removed the part of the SQL that removes and rebuilds the table, so I didn't lose any existing items (custom or not) that I already had in my table. Then, I just made sure that the schema for my table matched the PEQ table perfectly. Once that was done, I just sourced in the SQL entries and allowed it to error for all existing items in my table. I hadn't updated in over a year, and this last time I got about 12k new items added, which was really nice. The updated items are great if you are using SoF on your server.
It's funny, I was playing live last night, and someone mentioned a post by sony on one of its boards stating that there were around 80,000 items and around 3000 still undiscovered.

[AndMetal]

From the 13th Floor's website (http://eqitems.13th-floor.org/stats.php):


There are 79493 items in the database and 0 waiting to be approved.

Lowest item id is 1001. Highest item id is 119463.

[demonstar55]

If someone does take on this task make sure they contact CD about the patches he applies after he would import a new dump from 13th floor.

[cavedude]

I already dumped 13th floor, a couple of days ago. It'll be in the next PEQ SVN dump. I just had to make sure all was well with the items on TGC and it looks so.

[bergalas]

Im curious do you source them all by hand or use some kind of parser?

[cavedude]

There is a parser in the utils folder of the EQEmu SVN that does the actual sourcing. I have to manually add any new columns as the parser complains about them. Lastly, I source in an updates sql, which some have asked to be released but the problem is it changes nearly every time I update items. Before I release the table to the public, it's first tested on TGC. Once they have nailed down the major bugs (of which so far, there was only one small oversight on my part) it's then considered release worthy.

[bergalas]

I tried the parser in the eqemu repository, but it didnt work for me at all told me there was an error in my mysql syntax.any chance you could update that parser or am i using the wrong one? I used load_13thfloor_items.pl

[cavedude]

Nope, it works fine. That's the same one I used.

[bergalas]

C:\Perl>perl load_13thfloor_items.pl -d eqemu_config.xml <items.txt
DBD::mysql::db do failed: You have an error in your SQL syntax; check the manual
that corresponds to your MySQL server version for the right syntax to use near
'' at line 1 at load_13thfloor_items.pl line 72, <STDIN> line 2.

[bergalas]

i do believe its the empy fields (||) in the items.txt file

[cavedude]

The only thing I can think of, do you have DBD installed? If not, there is a tutorial somewhere around here that tells you how to install it.

[bergalas]

new error lol

DBD::mysql::db do failed: You have an error in your SQL syntax; check the manual
that corresponds to your MySQL server version for the right syntax to use near
'range,damage,color,itemtype,material,UNK060,elite material,sellrate,combateffect
s' at line 1 at load_13thfloor_items.pl line 72, <STDIN> line 3318.

[bergalas]

could range itself be a problem? as in a protected word in mysql?

[bergalas]

yep that IS the problem its a reserved word!

The following are new reserved words in MySQL 5.1:
ACCESSIBLE LINEAR MASTER_SSL_VERIFY_SERVER_CERT
RANGE READ_ONLY READ_WRITE

MySQL allows some keywords to be used as unquoted identifiers because many people previously used them. Examples are those in the following list:

[bergalas]

guess that means i need to downgrade mysql on my server

[bergalas]

UPDATE tested on my live webserver with mysql 5.0.51 ll required modules installed

DBD::mysql::db do failed: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '' at line 1 at load_13thfloor_items.pl line 72, <STDIN> line 721.

I would like to note that I checked the svn this file hasnt been updated since 2008 sept.

[bergalas]

could we add something to this
while(<STDIN>) {
chomp();
s/'/\\'/g;
@f=split("(?<!\\\\)\\|", $_);
$insert2=join("','",@f);
$#f--;
grep(s/\\\|/\\\\\|/g,@f);
grep(s/"/\\\\"/g,@f);
$statement=sprintf("%s%s','13THFLOOR',now()",$insert,$insert2,join('|',@f));
$dbh->do($statement);
printf("Processing: %d %s \r",$f[4],$f[1]);
++$count;
}

to replace || With |NULL|? Im not that good with perl

[AndMetal]

could we add something to this


to replace || With |NULL|? Im not that good with perl

I believe this will do the trick:


while(<STDIN>) {
chomp();
s/'/\\'/g;
s/||/|NULL|/g;
@f=split("(?<!\\\\)\\|", $_);
$insert2=join("','",@f);
$#f--;
grep(s/\\\|/\\\\\|/g,@f);
grep(s/"/\\\\"/g,@f);
$statement=sprintf("%s%s','13THFLOOR',now()",$inse rt,$insert2,join('|',@f));
$dbh->do($statement);
printf("Processing: %d %s \r",$f[4],$f[1]);
++$count;
}

[bergalas]

hmmm that didnt work either ugh i give up lol

[Andrew80k]

Nahh. That won't work. You'll need to escape the '|' with \ so:

s/\|\|/\|NULL\|/g;

the '|' is a special character in perl used as 'or' in regular expressions.

[nosfentora]

i'm not sure this will help, but if you quote range like this

`range`

mysql will accept it as a valid field identifier.

strictly speaking any field should be 'quoted' with the ` `, and values with ' '.