Go Back   EQEmulator Home > EQEmulator Forums > Development > Development::GeorgeS's Tools

Development::GeorgeS's Tools A forum just for GeorgeS's tools

Reply
 
Thread Tools Display Modes
  #16  
Old 06-29-2008, 01:05 AM
GeorgeS
Forum Guide
 
Join Date: Sep 2003
Location: California
Posts: 1,475
Default

Ok ran into a problem and need opinions

When one wants to choose a new spell (say for a click item), the program currently tries to load ~12000 spells which takes 40 seconds on my fast pc. Now this may be a problem on slower pc's. I cannot load the spells into memory and leave it there because it takes mucho memory. So my best option is for the user to search (partial name ok) for all matching spells and id's - that way it will only load those in memory and reduce processing time.


Does this sound plausable?

GeorgeS
__________________
Your source for EQ database tools
Toolshop is open for business


http://www.georgestools.chrsschb.com//
Reply With Quote
  #17  
Old 06-29-2008, 02:29 AM
trevius's Avatar
trevius
Developer
 
Join Date: Aug 2006
Location: USA
Posts: 5,946
Default

Hmm, on the line editor window, it only takes my PC about 3 seconds to load all 12K spells. I have the latest version of the editor, but the new edit doesn't have the spell search in it yet for me to test that. I don't suspect it should take any longer though if it was done the same way.

Maybe a window that doesn't automatically populate all 12K spells would work. Like, if you popped up a window with the option to search by partial name and it would list them. But, also have a button that would just list them all if you wanted to wait for them all to load?
__________________
Trevazar/Trevius Owner of: Storm Haven
Everquest Emulator FAQ (Frequently Asked Questions) - Read It!
Reply With Quote
  #18  
Old 06-29-2008, 02:52 AM
trevius's Avatar
trevius
Developer
 
Join Date: Aug 2006
Location: USA
Posts: 5,946
Default

Here are some notes on the new editor in it's current state and what I think could be adjusted or moved for further enhancement. Keep in mind that I understand that you are only halfway done with it (at least on the version that I have) and I know that you still have many things to do. So, I figure you probably already have some of this in mind to do while working on it, but maybe some of the notes will help:

1. The Deities part could probably be moved to the Race/Class area, since I think that is probably where it fits best as far as organizing it goes.

2. Slots could either go at the top between Icon and Color, or if you made the fonts smaller on the race/class section to shrink that part up a bit, you might be able to make enough room to do a similar check box section (with select all) for slots that includes all 20 slots in it. I didn't realize when I made the photoshop image that I left slots out lol.

3. The select all buttons for race/class currently do an inverse select instead of actually selecting all. This should work ok, but I thought you might want to know in case that wasn't intended.

4. The IDFile could probably be moved to the first section under Color and Icon.

5. If possible, it might be nice to have a Copy Item button like you have on the Line Editor window.

6. You could make the input fields for Recommended Level (and the other req/rec fields) as well as the Accuracy/Avoidance/etc fields. This would mainly be so that the sections don't overlap the row to the right of them. None of those would need very long fields for input anyway.

7. Icon could use an input field unless you plan to make a popup to select an icon from your viewer or something.

That is all I have for now. But as long as you are interested, I will be glad to give more feedback

I really like how you set the pull downs so that you can either select one of the pull down options or actually type anything you wish in that field. Very nice!

There are a ton of fields, and keeping them organized to make editing as clear as possible is one of the goals I had in mind for this. For the most part, you have everything right on, and I don't want to sound like I am trying to control how it is done because ultimately the decisions are all up to you. But, if you wanted more feedback, now you got some I think this is going to be amazing when it is complete. I am surprised with how complete you already have it! Can't thank you enough for what you do for us, GeorgeS!
__________________
Trevazar/Trevius Owner of: Storm Haven
Everquest Emulator FAQ (Frequently Asked Questions) - Read It!
Reply With Quote
  #19  
Old 06-29-2008, 09:23 PM
moydock
Discordant
 
Join Date: Jun 2005
Posts: 286
Default

Very pretty, I'll start testing .
__________________
-Croup (the rogue)
Creator of Pandemic (PvP-Racewars)
Reply With Quote
  #20  
Old 06-29-2008, 10:37 PM
knight1080
Sarnak
 
Join Date: May 2008
Location: x
Posts: 37
Default

Question--where am I supposed to drop the files that come in the .zip?
Reply With Quote
  #21  
Old 06-29-2008, 11:30 PM
trevius's Avatar
trevius
Developer
 
Join Date: Aug 2006
Location: USA
Posts: 5,946
Default

Quote:
Originally Posted by knight1080 View Post
Question--where am I supposed to drop the files that come in the .zip?
Where ever you want. I use my c:/unzipped directory, so the item editor is in C:/unzipped/eqitems.
__________________
Trevazar/Trevius Owner of: Storm Haven
Everquest Emulator FAQ (Frequently Asked Questions) - Read It!
Reply With Quote
  #22  
Old 06-29-2008, 11:56 PM
knight1080
Sarnak
 
Join Date: May 2008
Location: x
Posts: 37
Default

Eh, all right. I ask because I unzipped 'em to my server folder, tried to open, and got an error regarding a MySQL connection error, the db.ini which I changed prior, and an inquiry about installing the ODBC drivers. I ran the batch app in the resources folder, but still getting the error.
Reply With Quote
  #23  
Old 06-30-2008, 12:08 AM
moydock
Discordant
 
Join Date: Jun 2005
Posts: 286
Default

Install this and reboot:
http://66.159.225.58/eqemu/ODBC_DRIVERS.ZIP

The file is off George's site, it's ODBC drivers.
__________________
-Croup (the rogue)
Creator of Pandemic (PvP-Racewars)
Reply With Quote
  #24  
Old 06-30-2008, 12:17 AM
knight1080
Sarnak
 
Join Date: May 2008
Location: x
Posts: 37
Default

That did it--thanks a bunch!
Reply With Quote
  #25  
Old 06-30-2008, 09:13 PM
GeorgeS
Forum Guide
 
Join Date: Sep 2003
Location: California
Posts: 1,475
Default

Thanks for the suggestions - graphic changes will wait. I spent hours on those. Regarding the spell loading, the 12K load in a split second, but putting them in a grid takes a loong time. That's the problem. I have not found a solution for it. I will have to do it by name search I'm afraid.

GeorgeS
__________________
Your source for EQ database tools
Toolshop is open for business


http://www.georgestools.chrsschb.com//
Reply With Quote
  #26  
Old 06-30-2008, 09:55 PM
trevius's Avatar
trevius
Developer
 
Join Date: Aug 2006
Location: USA
Posts: 5,946
Default

Quote:
Originally Posted by GeorgeS View Post
Thanks for the suggestions - graphic changes will wait. I spent hours on those. Regarding the spell loading, the 12K load in a split second, but putting them in a grid takes a loong time. That's the problem. I have not found a solution for it. I will have to do it by name search I'm afraid.

GeorgeS
Oh, a grid to sort by name or ID by clicking columns? I think you could just do it the way the Line Editor does by loading from a file. Then just sort the file by name before adding it to the zip using excel the way I mentioned in another post. That way, it is easy for people to edit the spells.txt file so that they can have their own custom spells in it. A partial name search would be nice, but it would be good to have both options if possible.
__________________
Trevazar/Trevius Owner of: Storm Haven
Everquest Emulator FAQ (Frequently Asked Questions) - Read It!
Reply With Quote
  #27  
Old 07-01-2008, 10:26 AM
nosfentora
Discordant
 
Join Date: Oct 2004
Location: In a house
Posts: 377
Default

GeorgeS,

I have the all 20k spells loading and displaying in a listview in +/-12s on a P4 3GHz machine. Seems to use about 15mb of memory

Probably not the most efficient way to do things, but it's fairly quick (depending on your point of view). It can be easily modified to allow searching by partial name too.

It could be done at load time so that there's no further waiting later on - or even threaded load so it's kinda invisible, and then you just show / hide the listview as need be.

Code:
    If OpenFileDialog1.ShowDialog = Windows.Forms.DialogResult.OK Then
            Dim r As New IO.StreamReader(OpenFileDialog1.FileName)
            ListView1.BeginUpdate()
            While Not r.EndOfStream
                Dim s() As String = Split(r.ReadLine, "^")
                Dim lv As New ListViewItem(s(0))
                lv.SubItems.Add(New ListViewItem.ListViewSubItem(lv, s(1)))
                ListView1.Items.Add(lv)
                System.Windows.Forms.Application.DoEvents()
            End While
            ListView1.EndUpdate()
            r.Close()
            r.Dispose()
            r = Nothing
            GC.Collect()
        End If
Reply With Quote
  #28  
Old 07-01-2008, 01:45 PM
GeorgeS
Forum Guide
 
Join Date: Sep 2003
Location: California
Posts: 1,475
Default

Excellent - a breakthru - Now the entire spellset loads in like 5 sec.!!!

Did a iterative run thru every statement and found which one took the longest to run. The additem equivalent of the grid was taking about 50ms per loop or so. Now it's down in the high uSec range! Go figure - a simple statement nearly broke this.

Ok, so the program is again moving fwd... progress is good.

nosfentora - thnxs for the code

GeorgeS

Update as of Jul 1th
Spell lists are completed. Sorting by id/name ok and works
The program now allows the adding of custom spells effects to click items
A copy current item button added, and the code works for it!!
Next is the code to save the entire dataset- may take a few days.. this is the last thing to do
__________________
Your source for EQ database tools
Toolshop is open for business


http://www.georgestools.chrsschb.com//

Last edited by GeorgeS; 07-03-2008 at 09:26 PM..
Reply With Quote
  #29  
Old 07-01-2008, 01:48 PM
nosfentora
Discordant
 
Join Date: Oct 2004
Location: In a house
Posts: 377
Default

No problem - hope it helps!

Cheers!
Reply With Quote
  #30  
Old 07-03-2008, 01:29 PM
GeorgeS
Forum Guide
 
Join Date: Sep 2003
Location: California
Posts: 1,475
Default

Update as of Jul 3th
Managed to finish the save items, and also have the copy item working.
Also done is color editing within the new edit context.
Done also is the clicky items spell selection and verified they work

I'm going over the code and checking it in the db for errors. Plenty found and fixed, but imagine a few days left to fix the rest.

People always want to make clicky items, and with this tool, it takes some of the guesswork out by prefilling some fields so they work.

I'm pretty impressed that it was not so bad. Probably 2 weeks of total work.

GeorgeS
__________________
Your source for EQ database tools
Toolshop is open for business


http://www.georgestools.chrsschb.com//
Reply With Quote
Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

   

All times are GMT -4. The time now is 10:53 AM.


 

Everquest is a registered trademark of Daybreak Game Company LLC.
EQEmulator is not associated or affiliated in any way with Daybreak Game Company LLC.
Except where otherwise noted, this site is licensed under a Creative Commons License.
       
Powered by vBulletin®, Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Template by Bluepearl Design and vBulletin Templates - Ver3.3