PDA

View Full Version : EQEmu Blob to Database Conversion


Akkadius
09-06-2014, 03:22 PM
I'm streaming C coding while I'm working on converting the entire character blob over to actual database tables.

I've been working on this over the past few weeks and am about 95% done, however if anyone is interested I have a stream up.

Some people have asked for it in the past so I just put it up while I'm working on stuff anyways.

www.twitch.tv/akkadius

Enjoy.

To give an idea why I am converting the character blob to database tables, 1) we've been wanting to do this forever for many reasons.

1) It will increase overall code performance more than 10 fold with all of the inefficient calls for saving and loading that we do in the database
2) We are saving a lot of blank data, for example EZ's database of characters is 2.6GB, after a mock convert I end up storing approximately 600MB in total in data broken out into individual tables.
3) The speed increase is phenominal as we are not saving everything every single time that a character has done a single little action.
- Whenever a character ups a skill point or spams it, everything is saved (skills/languages/aa/spells/character data/etc)
- Same thing goes for AA's, whenever a character loots or moves coins
- Everytime these save actions are spammed, the character_ table is locked, which leaves an opportunity for hangs to occur at any process because it is waiting for the character_ table to be opened. This is in the end, very inefficient.

GeorgeS
09-28-2014, 01:36 AM
I'm updating my tools, and see character_ table has changed..
Do you have any info what character_ binary data is converted to?
(or a tool would help - if you have one)

Thanks
GeorgeS

Akkadius
09-28-2014, 01:41 AM
I'm updating my tools, and see character_ table has changed..
Do you have any info what character_ binary data is converted to?
(or a tool would help - if you have one)

Thanks
GeorgeS

Not sure what you mean, but these are the tables that are created in the auto conversion from blob convert, in the repack you setup you should be able to view the table schema accordingly:

`character_skills`
`character_languages`
`character_bind`
`character_alternate_abilities`
`character_currency`
`character_data`
`character_spells`
`character_memmed_spells`
`character_disciplines`
`character_material`
`character_tribute`
`character_bandolier`
`character_inspect_messages`
`character_leadership_abilities`

GeorgeS
09-28-2014, 10:24 AM
Thanks, I figured it out eventually, but it's a large task to convert my characters over to the new tables. Is there a tool to do this out there?

GeorgeS

Kayen
09-28-2014, 10:33 AM
It coverts it automatically when you start your server for the first time while running the current source code.

Just back your database up first just in case.

Nibiuno
11-15-2014, 10:42 AM
Have you tested mercenaries after a conversion from the character blob system to the database tables? I can't seem to get them to work post conversion, but if I do not convert, they work fine.