View Single Post
  #1  
Old 09-27-2012, 11:14 PM
Akkadius's Avatar
Akkadius
Administrator
 
Join Date: Feb 2009
Location: MN
Posts: 2,071
Default Live Data Collection (Need Community Help)

I'm going to make this short and sweet.

We have made huge ground parsing Magelo's site for large amounts of data to catch up PEQ all the way through the current expansion. I spent time to write a web crawler that has gathered all of the following data types from all expansions to now:
  • Merchantlists
  • Loot
  • Tradeskills
  • Spawnpoints

I will be working on getting these in one by one, my life has been super busy and it has been hard to make time for things but I'm still trying to get these things knocked out because they are rather large. I also am not rushing because Cavedude is in the middle of moving, I am probably going to end up moving here shortly myself.

Asking the Community for Help:
Anyways, I need help from the community to collect logs from live. These are the logs that are generated from /log in-game from any and all time frames that have ever been played.

What will this enable us to do?
We will be able to collect quite a wide variety of data that just simply can't be automated through web sources. This will allow us to collect:
  • NPC Relative Health
  • NPC Spell Casts
  • NPC Faction hits
  • NPC Damage Data
  • NPC Aggro Emotes
  • NPC Death Emotes
  • Other things I'm not thinking of right now

If we can get log data from PEQ's more recent expansions (GoD, LDON) all the way through the current expansion the more we will be able to fill in the gaps of all of the data that gets manually processed through the development procedures and standards that PEQ has put in place today.

My effort is going to be to take logs from players anonymously through a form and have a script go through and tear through the data existing through those logs. These logs will be kept privately and will only be used for the benefit of this community and will only be seen by trusted developers.

The UPLOAD form can be found here: http://eoc.akkadius.com/eoc/EQEmuDat...gCollector.php

Simply upload a eqlog file of your EverQuest live characters and once the data parsing process begins, I will try to make a way to have people see what NPC's have been collected in what zones and what hasn't collected so we can take an accurate hitlist against what we need to collect as a community.

This will take a while as we get people to dump their historic logs from the past, I encourage everyone to reach out to anyone they might know to help this process move along so we can get more data.

How/What:
  • Typing /log in game in eqemu will create a logfile under EverQuest/Logs/eqlog_charname_servername.txt
  • We will need preferably HUGE logs that contain data spanning several zones, old and big logs are completely fine
  • The more combat spam the better, I don't care about /gu or /t messages, I won't be caring about any of that


If anyone has any questions about this please feel free to post.

Last edited by Akkadius; 09-30-2012 at 12:07 PM..
Reply With Quote