Jump to content

Battlelog Cache (1.0.1.0 - 14/1/13)


ImportBot

Recommended Posts

Originally Posted by PapaCharlie9*:

 

I've noticed that my database constantly grows over time. It would seem good hygiene to purge it every week or so. How would I do this? I think I can figure out how to run a script weekly, but I'm not sure about the SQL. What's the SQL to delete every row that is older than 7 days from the current date? Basing the age on the timestampClanTag field would be sufficient.

* Restored post. It could be that the author is no longer active.
Link to comment
  • Replies 127
  • Created
  • Last Reply

Originally Posted by MorpheusX(AUT)*:

 

To delete the whole table, you could simply run

Code:

TRUNCATE TABLE <stats-table-name>;
If you want to remove all entries older than a certain date, I suggest using the command

Code:

DELETE FROM <stats-table-name> WHERE DATEDIFF(CURRENT_TIMESTAMP, timestampOverview) > 7;
Above code hasn't been tested yet, but should work... You might want to change the timestamp compared or add the other ones with OR + more DATEDIFF-commands.
* Restored post. It could be that the author is no longer active.
Link to comment

Originally Posted by XpKiller*:

 

@PapaCharlie9

 

how much does you db grow per week?

 

I have the feeling that the table could be improved.

Could anybody post some rows out of the table here. I have no own bf3 server anymore.

* Restored post. It could be that the author is no longer active.
Link to comment

Originally Posted by MorpheusX(AUT)*:

 

http://morpheusx.at/procon/battlelog...ple_export.xml

 

XML seemed like the best way to export data since CSV or SQL was quite unclear due to "raw" JSON-strings being stored.

This database was just "randomely" filled (sample-plugin requests one out of three stats on every player's join), I extracted those colums with the most data (both overview and vehicle stats), vehicleStats never were requested.

 

EDIT: the table-structure isn't quite optimal I guess, but since I'm no real database-engineer, I just threw something together :P Will probably have to be adapted for the caching-server, not quite sure how though.

* Restored post. It could be that the author is no longer active.
Link to comment

Originally Posted by PapaCharlie9*:

 

how much does you db grow per week?

About 50Mb a week. It's not huge growth, but that will add up over time.

 

That's with an average of approximately 800 new rows a day.

 

I don't think database redesign will have much impact. I think it has more to do with the way a cache works and the frequency of new player joins for this particularly server, which is very popular (C2C air maps). Also, I only measured for 2 weeks starting from an empty table. It might be that at some point the growth will level off, once the entire player pool has been cached. But it's a big, worldwide player pool.

* Restored post. It could be that the author is no longer active.
Link to comment

Originally Posted by XpKiller*:

 

About 50Mb a week. It's not huge growth, but that will add up over time.

 

That's with an average of approximately 800 new rows a day.

 

I don't think database redesign will have much impact. I think it has more to do with the way a cache works and the frequency of new player joins for this particularly server, which is very popular (C2C air maps). Also, I only measured for 2 weeks starting from an empty table. It might be that at some point the growth will level off, once the entire player pool has been cached. But it's a big, worldwide player pool.

nah, we have no real database here. It more or less a key value store. A perfect job for NoSQL.

 

Anyway the size can reduced by using proper columns types:

 

Drop in replacement should work:

Code:

CREATE TABLE `playerstats` (
  `personaId` bigint(20) unsigned NOT NULL,
  `playerName` varchar(32) COLLATE utf8_bin NOT NULL,
  `clanTag` varchar(8) COLLATE utf8_bin DEFAULT NULL,
  `overviewStats` longtext COLLATE utf8_bin,
  `weaponStats` longtext COLLATE utf8_bin,
  `vehicleStats` longtext COLLATE utf8_bin,
  `generalStatus` text COLLATE utf8_bin,
  `overviewStatsError` text COLLATE utf8_bin,
  `weaponStatsError` text COLLATE utf8_bin,
  `vehicleStatsError` text COLLATE utf8_bin,
  `timestampOverview` timestamp NULL DEFAULT NULL,
  `timestampWeapon` timestamp NULL DEFAULT NULL,
  `timestampVehicle` timestamp NULL DEFAULT NULL,
  `timestampClanTag` timestamp NULL DEFAULT NULL,
  PRIMARY KEY (`personaId`),
  UNIQUE KEY `playerName` (`playerName`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8 COLLATE=utf8_bin
The same thing with table compression:

Code:

CREATE TABLE `playerstats` (
  `personaId` bigint(20) unsigned NOT NULL,
  `playerName` varchar(32) COLLATE utf8_bin NOT NULL,
  `clanTag` varchar(8) COLLATE utf8_bin DEFAULT NULL,
  `overviewStats` longtext COLLATE utf8_bin,
  `weaponStats` longtext COLLATE utf8_bin,
  `vehicleStats` longtext COLLATE utf8_bin,
  `generalStatus` text COLLATE utf8_bin,
  `overviewStatsError` text COLLATE utf8_bin,
  `weaponStatsError` text COLLATE utf8_bin,
  `vehicleStatsError` text COLLATE utf8_bin,
  `timestampOverview` timestamp NULL DEFAULT NULL,
  `timestampWeapon` timestamp NULL DEFAULT NULL,
  `timestampVehicle` timestamp NULL DEFAULT NULL,
  `timestampClanTag` timestamp NULL DEFAULT NULL,
  PRIMARY KEY (`personaId`),
  UNIQUE KEY `playerName` (`playerName`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8 COLLATE=utf8_bin ROW_FORMAT=COMPRESSED
Now optimized(may need changes in the plugin):

Code:

CREATE TABLE `playerstats` (
  `personaId` bigint(20) unsigned NOT NULL,
  `playerName` varchar(32) COLLATE utf8_bin NOT NULL,
  `clanTag` varchar(8) COLLATE utf8_bin DEFAULT NULL,
  `overviewStats` longtext COLLATE utf8_bin,
  `weaponStats` longtext COLLATE utf8_bin,
  `vehicleStats` longtext COLLATE utf8_bin,
  `generalStatus` enum('Success','Failed') COLLATE utf8_bin DEFAULT NULL,
  `overviewStatsError` tinyint(1) DEFAULT NULL,
  `weaponStatsError` tinyint(1) DEFAULT NULL,
  `vehicleStatsError` tinyint(1) DEFAULT NULL,
  `timestampOverview` timestamp NULL DEFAULT NULL,
  `timestampWeapon` timestamp NULL DEFAULT NULL,
  `timestampVehicle` timestamp NULL DEFAULT NULL,
  `timestampClanTag` timestamp NULL DEFAULT NULL,
  PRIMARY KEY (`personaId`),
  UNIQUE KEY `playerName` (`playerName`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8 COLLATE=utf8_bin ROW_FORMAT=COMPRESSED
The table design has a weakness and could have problems if a player changes his name since we are not knowing the persona. So it might be the best to make the playername as PK, since PK lockups are the fastest lookups in innodb.
* Restored post. It could be that the author is no longer active.
Link to comment

Originally Posted by MorpheusX(AUT)*:

 

I've thought about giving NoSQL-databases a try, especially MongoDB (mainly because phogue is a great fanboy of MongoDB and wanted me to take a look :biggrin:). However, I'll try to get a first version up and running with MySQL (since I'm already used to that) and will then try to create a comparison with NoSQL.

 

Thanks for the hints on the table structure though, will play around with the final structure for the caching server... Compression saved about 3MB on a 60MB database.

 

Good point about the name-change, we cannot make the personaId unique then though, since there might be the possibility of two same personaIds with different player-names.

* Restored post. It could be that the author is no longer active.
Link to comment

Originally Posted by XpKiller*:

 

I've thought about giving NoSQL-databases a try, especially MongoDB (mainly because phogue is a great fanboy of MongoDB and wanted me to take a look :biggrin:). However, I'll try to get a first version up and running with MySQL (since I'm already used to that) and will then try to create a comparison with NoSQL.

Yeah but MySQL is far more often in use.

 

Thanks for the hints on the table structure though, will play around with the final structure for the caching server... Compression saved about 3MB on a 60MB database.

If the grain is so low, compression should be disabled, Then it just cost performance. The data seems to be to random.

 

Good point about the name-change, we cannot make the personaId unique then though, since there might be the possibility of two same personaIds with different player-names.

How a about

Code:

CREATE TABLE `playerstats` (
  `personaId` bigint(20) unsigned NOT NULL,
  `playerName` varchar(32) COLLATE utf8_bin NOT NULL,
  `clanTag` varchar(8) COLLATE utf8_bin DEFAULT NULL,
  `overviewStats` longtext COLLATE utf8_bin,
  `weaponStats` longtext COLLATE utf8_bin,
  `vehicleStats` longtext COLLATE utf8_bin,
  `generalStatus` enum('Success','Failed') COLLATE utf8_bin DEFAULT NULL,
  `overviewStatsError` tinyint(1) DEFAULT NULL,
  `weaponStatsError` tinyint(1) DEFAULT NULL,
  `vehicleStatsError` tinyint(1) DEFAULT NULL,
  `timestampOverview` timestamp NULL DEFAULT NULL,
  `timestampWeapon` timestamp NULL DEFAULT NULL,
  `timestampVehicle` timestamp NULL DEFAULT NULL,
  `timestampClanTag` timestamp NULL DEFAULT NULL,
  PRIMARY KEY (`playerName`,`personaId`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8 COLLATE=utf8_bin
but you still would have problems on name changes. Since we dont have a possiblity to search for a ea guid or stuff like that.
* Restored post. It could be that the author is no longer active.
Link to comment

Originally Posted by trondsbr*:

 

Any ideas?

 

Code:

[17:40:05] [Battlelog Cache] [Battlelog Cache] EXCEPTION: System.ArgumentException: Format of the initialization string does not conform to specification starting at index 84.
   at System.Data.Common.DbConnectionOptions.GetKeyValuePair(String connectionString, Int32 currentPosition, StringBuilder buffer, Boolean useOdbcRules, String& keyname, String& keyvalue)
   at System.Data.Common.DbConnectionOptions.ParseInternal(Hashtable parsetable, String connectionString, Boolean buildChain, Hashtable synonyms, Boolean firstKey)
   at System.Data.Common.DbConnectionOptions..ctor(String connectionString, Hashtable synonyms, Boolean useOdbcRules)
   at System.Data.Common.DbConnectionStringBuilder.set_ConnectionString(String value)
   at MySql.Data.MySqlClient.MySqlConnection.set_ConnectionString(String value)
   at MySql.Data.MySqlClient.MySqlConnection..ctor(String connectionString)
   at PRoConEvents.CBattlelogCache.MySqlInsert(Object insertData)
* Restored post. It could be that the author is no longer active.
Link to comment
  • 2 weeks later...

Originally Posted by kcuestag*:

 

I've set Battlelog Cache, made sure it's using "playerstats" for MySQL Table, and I have set Debug level to 6, but I see nothing at the debug monitor, only when I enable and disable the plugin, is this normal?

* Restored post. It could be that the author is no longer active.
Link to comment

Originally Posted by MorpheusX(AUT)*:

 

I've set Battlelog Cache, made sure it's using "playerstats" for MySQL Table, and I have set Debug level to 6, but I see nothing at the debug monitor, only when I enable and disable the plugin, is this normal?

Do you run any plugin using it (like IL with some Battelog-stats code)? BattlelogCache will not do anything on its own.
* Restored post. It could be that the author is no longer active.
Link to comment

Originally Posted by kcuestag*:

 

I see, I'm not, at the moment I don't think any plugins I use actually use Battlelog cache, thanks.

 

Hoping plugins soon start to use it like CheatDetector and True Balancer or the new balancer being made.

* Restored post. It could be that the author is no longer active.
Link to comment

Originally Posted by _gp_*:

 

I have mysql server set up and appears to be running,

 

Battlelog cache is giving this error when debug set to 6

 

[battlelog Cache] [battlelog Cache] EXCEPTION: MySql.Data.MySqlClient.MySqlException: Incorrect table name 'playerstats

'

at MySql.Data.MySqlClient.MySqlStream.ReadPacket()

at MySql.Data.MySqlClient.NativeDriver.GetResult(Int3 2& affectedRow, Int64& insertedId)

at MySql.Data.MySqlClient.Driver.GetResult(Int32 statementId, Int32& affectedRows, Int64& insertedId)

at MySql.Data.MySqlClient.Driver.NextResult(Int32 statementId, Boolean force)

at MySql.Data.MySqlClient.MySqlDataReader.NextResult( )

at MySql.Data.MySqlClient.MySqlCommand.ExecuteReader( CommandBehavior behavior)

at MySql.Data.MySqlClient.MySqlCommand.ExecuteNonQuer y()

at PRoConEvents.CBattlelogCache.MySqlInsert(Object insertData)

 

 

_gp?

* Restored post. It could be that the author is no longer active.
Link to comment

Originally Posted by MorpheusX(AUT)*:

 

It seems like there's a linebreak in your table-name (note how it shows the second ' in the next line, not right after 'playerstats). Have you tried deleting the content of your "MySQL Table" variable and re-setting it again, checking that there are no special characters, tabs, spaces or linebreaks in there this time?

* Restored post. It could be that the author is no longer active.
Link to comment

Originally Posted by _gp_*:

 

It seems like there's a linebreak in your table-name (note how it shows the second ' in the next line, not right after 'playerstats). Have you tried deleting the content of your "MySQL Table" variable and re-setting it again, checking that there are no special characters, tabs, spaces or linebreaks in there this time?

I am not sure what was going on. I ended up dropping table I had created, making a new table with a different name with same error. (creating and dropping tables multiple times)...

 

I eventually created another playerstats table, from post 26 (thx again PC9), which meant I had 2 tables, I then dropped other table and database is now working, go figure :smile:

 

reminds me of M$ windows madness, keep on re-installing till it works....

 

thx for the help,

 

_gp?

* Restored post. It could be that the author is no longer active.
Link to comment

Originally Posted by _gp_*:

 

I am not sure what was going on. I ended up dropping table I had created, making a new table with a different name with same error. (creating and dropping tables multiple times)...

 

I eventually created another playerstats table, from post 26 (thx again PC9), which meant I had 2 tables, I then dropped other table and database is now working, go figure :smile:

 

reminds me of M$ windows madness, keep on re-installing till it works....

 

thx for the help,

 

_gp?

Appears I spoke to soon, Table Data starts out OK, player name and dogtag if there is one. the rest of data looks like Capture.PNG

 

there are also a few NULL entries..Capture2.PNGCapture3.PNG

 

so there would still be some special characters? in table script.

 

_gp?

* Restored post. It could be that the author is no longer active.
Link to comment

Originally Posted by MorpheusX(AUT)*:

 

All fine. That's the way BattlelogCache works :smile:

Since plugins parse the json-strings from Battlelog anyways, theres no need to split all values up, store them seperately and merge them together when transmittig. This way is just way qicker.

* Restored post. It could be that the author is no longer active.
Link to comment

Originally Posted by _gp_*:

 

All fine. That's the way BattlelogCache works :smile:

Since plugins parse the json-strings from Battlelog anyways, theres no need to split all values up, store them seperately and merge them together when transmittig. This way is just way qicker.

Thank You for your help sir

 

_gp?

* Restored post. It could be that the author is no longer active.
Link to comment

Originally Posted by kcuestag*:

 

I'm getting this on the debug monitor after installing Cheat Detector, my first plugin that uses Battlelog Cache:

 

[battlelog Cache] EXCEPTION: MySql.Data.MySqlClient.MySqlException: Table 'oaks.playerstats' doesn't exist

at MySql.Data.MySqlClient.MySqlStream.ReadPacket()

at MySql.Data.MySqlClient.NativeDriver.GetResult(Int3 2& affectedRow, Int64& insertedId)

at MySql.Data.MySqlClient.Driver.GetResult(Int32 statementId, Int32& affectedRows, Int64& insertedId)

at MySql.Data.MySqlClient.Driver.NextResult(Int32 statementId, Boolean force)

at MySql.Data.MySqlClient.MySqlDataReader.NextResult( )

at MySql.Data.MySqlClient.MySqlCommand.ExecuteReader( CommandBehavior behavior)

at MySql.Data.MySqlClient.MySqlCommand.ExecuteNonQuer y()

at PRoConEvents.CBattlelogCache.MySqlInsert(Object insertData)

 

 

Any ideas?

 

Edit:

 

Here's a bit more:

 

Code:

[20:43:22 17] [Battlelog Cache] BattlelogLookup created WebClient...
[20:43:22 17] [Battlelog Cache] No personaId for player or requestType was clanTag...
[20:43:22 24] AdaptiveServerSize: IDLE -> 55 players online. 4 players joining. Server size set to 64. Round started at 64.
[20:43:22 33] [Battlelog Cache] DownloadWebPage for URL 'http://battlelog.battlefield.com/bf3/user/Girl-land' took 0.16 seconds
[20:43:22 33] [Battlelog Cache] Extracting personaId...
[20:43:22 33] [Battlelog Cache] Extracting clanTag...
[20:43:22 33] [Battlelog Cache] clanTag is empty
[20:43:22 33] [Battlelog Cache] Performing requestType-lookup for personaId 365703815...
[20:43:24 63] [Battlelog Cache] DownloadWebPage for URL 'http://battlelog.battlefield.com/bf3/weaponsPopulateStats/365703815/1' took 2.30 seconds
[20:43:24 90] [Battlelog Cache] BattlelogLookup returning weaponStats...
[20:43:24 90] [Battlelog Cache] MySqlInsert starting!
[20:43:24 92] [Battlelog Cache] RequestLoop locking lookupResponses (adding new response)
[20:43:24 92] [Battlelog Cache] RequestLoop releasing lookupResponses (adding new response)
[20:43:24 92] [Battlelog Cache] RequestLoop locking lookupRequests (deleting old request)
[20:43:24 92] [Battlelog Cache] RequestLoop releasing lookupRequests (deleting old request)
[20:43:24 92] [Battlelog Cache] Finished lookupRequest #0...
[20:43:24 92] [Battlelog Cache] Finished all lookupRequests...
[20:43:24 92] [Battlelog Cache] RequestQueue empty, waiting...
[20:43:24 92] [Battlelog Cache] [Battlelog Cache] EXCEPTION: MySql.Data.MySqlClient.MySqlException: Table 'oaks.playerstats' doesn't exist
   at MySql.Data.MySqlClient.MySqlStream.ReadPacket()
   at MySql.Data.MySqlClient.NativeDriver.GetResult(Int32& affectedRow, Int64& insertedId)
   at MySql.Data.MySqlClient.Driver.GetResult(Int32 statementId, Int32& affectedRows, Int64& insertedId)
   at MySql.Data.MySqlClient.Driver.NextResult(Int32 statementId, Boolean force)
   at MySql.Data.MySqlClient.MySqlDataReader.NextResult()
   at MySql.Data.MySqlClient.MySqlCommand.ExecuteReader(CommandBehavior behavior)
   at MySql.Data.MySqlClient.MySqlCommand.ExecuteNonQuery()
   at PRoConEvents.CBattlelogCache.MySqlInsert(Object insertData)
[20:43:24 92] [Battlelog Cache] ResponseLoop active...
[20:43:24 92] [Battlelog Cache] MySqlInsert finished!
[20:43:24 92] [Battlelog Cache] ResponseLoop locking lookupResponses (creating local copy)
[20:43:24 92] [Battlelog Cache] ResponseLoop releasing lookupResponses (creating local copy)
[20:43:24 92] [Battlelog Cache] 1 lookupResponses in queue...
[20:43:24 93] [Battlelog Cache] Performing lookupResponse #0...
[20:43:24 93] CD - Girl-land: 0%
[20:43:24 93] [Battlelog Cache] ResponseLoop locking lookupResponses (removing old response)
[20:43:24 93] [Battlelog Cache] ResponseLoop releasing lookupResponses (removing old response)
[20:43:24 93] [Battlelog Cache] Finished lookupResponse #0...
[20:43:24 93] [Battlelog Cache] Finished all lookupResponses...
[20:43:24 93] [Battlelog Cache] ResponseQueue empty, waiting...
Is Battlelog Cache working properly or do I have something wrong?
* Restored post. It could be that the author is no longer active.
Link to comment

Originally Posted by kcuestag*:

 

I changed the "table" from "playerstats" to "tbl_playerstats" and now I get this:

 

Code:

[21:22:28 29] [Battlelog Cache] [Battlelog Cache] EXCEPTION: MySql.Data.MySqlClient.MySqlException: Unknown column 'personaId' in 'field list'
   at MySql.Data.MySqlClient.MySqlStream.ReadPacket()
   at MySql.Data.MySqlClient.NativeDriver.GetResult(Int32& affectedRow, Int64& insertedId)
   at MySql.Data.MySqlClient.Driver.GetResult(Int32 statementId, Int32& affectedRows, Int64& insertedId)
   at MySql.Data.MySqlClient.Driver.NextResult(Int32 statementId, Boolean force)
   at MySql.Data.MySqlClient.MySqlDataReader.NextResult()
   at MySql.Data.MySqlClient.MySqlCommand.ExecuteReader(CommandBehavior behavior)
   at MySql.Data.MySqlClient.MySqlCommand.ExecuteNonQuery()
   at PRoConEvents.CBattlelogCache.MySqlInsert(Object insertData)
Is this normal?
* Restored post. It could be that the author is no longer active.
Link to comment

Originally Posted by Phil_K*:

 

Hi

 

I changed the "table" from "playerstats" to "tbl_playerstats" and now I get this:

 

Code:

[21:22:28 29] [Battlelog Cache] [Battlelog Cache] EXCEPTION: MySql.Data.MySqlClient.MySqlException: Unknown column 'personaId' in 'field list'
Is this normal?
No. Based on the error the mysql part gives back it seems your newly used table is missing the column called "personaId".

Check if the playerstats table to use with BC was created correctly.

 

Did you use something like

code to create:

 

 

Code:

CREATE TABLE IF NOT EXISTS `playerstats` (
	`personaId` VARCHAR(50) NOT NULL COLLATE 'utf8_bin',
	`playerName` VARCHAR(32) NOT NULL COLLATE 'utf8_bin',
	`clanTag` VARCHAR(8) NULL DEFAULT NULL COLLATE 'utf8_bin',
	`overviewStats` LONGTEXT NULL COLLATE 'utf8_bin',
	`weaponStats` LONGTEXT NULL COLLATE 'utf8_bin',
	`vehicleStats` LONGTEXT NULL COLLATE 'utf8_bin',
	`generalStatus` TEXT NULL COLLATE 'utf8_bin',
	`overviewStatsError` TEXT NULL COLLATE 'utf8_bin',
	`weaponStatsError` TEXT NULL COLLATE 'utf8_bin',
	`vehicleStatsError` TEXT NULL COLLATE 'utf8_bin',
	`timestampOverview` TIMESTAMP NULL DEFAULT NULL,
	`timestampWeapon` TIMESTAMP NULL DEFAULT NULL,
	`timestampVehicle` TIMESTAMP NULL DEFAULT NULL,
	`timestampClanTag` TIMESTAMP NULL DEFAULT NULL,
	PRIMARY KEY (`personaId`),
	UNIQUE INDEX `playerName` (`playerName`)
)
COLLATE='utf8_bin'
ENGINE=InnoDB;

 

 

to create it?

 

Greets

Phil.

* Restored post. It could be that the author is no longer active.
Link to comment

Originally Posted by Glock*:

 

Hi

 

 

 

No. Based on the error the mysql part gives back it seems your newly used table is missing the column called "personaId".

Check if the playerstats table to use with BC was created correctly.

 

Did you use something like

code to create:

 

 

Code:

CREATE TABLE IF NOT EXISTS `playerstats` (
    `personaId` VARCHAR(50) NOT NULL COLLATE 'utf8_bin',
    `playerName` VARCHAR(32) NOT NULL COLLATE 'utf8_bin',
    `clanTag` VARCHAR(8) NULL DEFAULT NULL COLLATE 'utf8_bin',
    `overviewStats` LONGTEXT NULL COLLATE 'utf8_bin',
    `weaponStats` LONGTEXT NULL COLLATE 'utf8_bin',
    `vehicleStats` LONGTEXT NULL COLLATE 'utf8_bin',
    `generalStatus` TEXT NULL COLLATE 'utf8_bin',
    `overviewStatsError` TEXT NULL COLLATE 'utf8_bin',
    `weaponStatsError` TEXT NULL COLLATE 'utf8_bin',
    `vehicleStatsError` TEXT NULL COLLATE 'utf8_bin',
    `timestampOverview` TIMESTAMP NULL DEFAULT NULL,
    `timestampWeapon` TIMESTAMP NULL DEFAULT NULL,
    `timestampVehicle` TIMESTAMP NULL DEFAULT NULL,
    `timestampClanTag` TIMESTAMP NULL DEFAULT NULL,
    PRIMARY KEY (`personaId`),
    UNIQUE INDEX `playerName` (`playerName`)
)
COLLATE='utf8_bin'
ENGINE=InnoDB;

 

 

to create it?

 

Greets

Phil.

Yep that was it, thanks.

I am unsure as to why the table wasn't created in the first instance though, when everything else was there_..

* Restored post. It could be that the author is no longer active.
Link to comment

Originally Posted by kcuestag*:

 

Thanks Phil, and thanks Glock (Kris) for fixing it!

 

Is it working as intended now Phil?

 

Code:

[17:05:20 32] [Battlelog Cache] AddRequest starting!
[17:05:20 32] [Battlelog Cache] AddRequest locking lookupRequests (adding new request)
[17:05:20 32] [Battlelog Cache] AddRequest releasing lookupRequests (adding new request)
[17:05:20 33] [Battlelog Cache] AddRequest finished!
[17:05:20 33] [Battlelog Cache] AddRequest starting!
[17:05:20 33] [Battlelog Cache] RequestLoop active...
[17:05:20 33] [Battlelog Cache] RequestLoop locking lookupRequests (creating local copy)
[17:05:20 33] [Battlelog Cache] RequestLoop releasing lookupRequests (creating local copy)
[17:05:20 35] [Battlelog Cache] 1 lookupRequests in queue...
[17:05:20 35] [Battlelog Cache] Performing lookupRequest #0...
[17:05:20 35] [Battlelog Cache] Performing lookup for player 'Reverend9' with requestType 'Overview'...
[17:05:20 38] [Battlelog Cache] MySqlLookup starting!
[17:05:20 38] [Battlelog Cache] MySqlLookup finished!
[17:05:20 38] [Battlelog Cache] No valid stats for player 'Reverend9' with requestType 'Overview' found in MySQL-database. Fetching stats...
[17:05:20 38] [Battlelog Cache] BattlelogLookup created WebClient...
[17:05:20 38] [Battlelog Cache] No personaId for player or requestType was clanTag...
[17:05:20 40] [Battlelog Cache] AddRequest locking lookupRequests (adding new request)
[17:05:20 40] [Battlelog Cache] AddRequest releasing lookupRequests (adding new request)
[17:05:20 40] [Battlelog Cache] AddRequest finished!
[17:05:20 58] [Battlelog Cache] DownloadWebPage for URL 'http://battlelog.battlefield.com/bf3/user/Reverend9' took 0.20 seconds
[17:05:20 60] [Battlelog Cache] Extracting personaId...
[17:05:20 60] [Battlelog Cache] Extracting clanTag...
[17:05:20 60] [Battlelog Cache] clanTag is empty
[17:05:20 60] [Battlelog Cache] Performing requestType-lookup for personaId 517569938...
[17:05:20 96] [Battlelog Cache] DownloadWebPage for URL 'http://battlelog.battlefield.com/bf3/overviewPopulateStats/517569938/bf3-us-engineer/1' took 0.36 seconds
[17:05:21 04] [Battlelog Cache] BattlelogLookup returning overviewStats...
[17:05:21 04] [Battlelog Cache] MySqlInsert starting!
[17:05:21 04] [Battlelog Cache] RequestLoop locking lookupResponses (adding new response)
[17:05:21 04] [Battlelog Cache] RequestLoop releasing lookupResponses (adding new response)
[17:05:21 04] [Battlelog Cache] RequestLoop locking lookupRequests (deleting old request)
[17:05:21 04] [Battlelog Cache] RequestLoop releasing lookupRequests (deleting old request)
[17:05:21 04] [Battlelog Cache] ResponseLoop active...
[17:05:21 04] [Battlelog Cache] Finished lookupRequest #0...
[17:05:21 04] [Battlelog Cache] Finished all lookupRequests...
[17:05:21 04] [Battlelog Cache] RequestLoop active...
[17:05:21 04] [Battlelog Cache] RequestLoop locking lookupRequests (creating local copy)
[17:05:21 04] [Battlelog Cache] RequestLoop releasing lookupRequests (creating local copy)
[17:05:21 04] [Battlelog Cache] 1 lookupRequests in queue...
[17:05:21 04] [Battlelog Cache] Performing lookupRequest #0...
[17:05:21 04] [Battlelog Cache] Performing lookup for player 'Reverend9' with requestType 'Weapon'...
[17:05:21 04] [Battlelog Cache] MySqlLookup starting!
[17:05:21 05] [Battlelog Cache] MySqlLookup finished!
[17:05:21 05] [Battlelog Cache] No valid stats for player 'Reverend9' with requestType 'Weapon' found in MySQL-database. Fetching stats...
[17:05:21 05] [Battlelog Cache] Waiting for 1.9844 seconds to avoid Battlelog throtteling...
[17:05:21 05] [Battlelog Cache] ResponseLoop locking lookupResponses (creating local copy)
[17:05:21 05] [Battlelog Cache] ResponseLoop releasing lookupResponses (creating local copy)
[17:05:21 05] [Battlelog Cache] 1 lookupResponses in queue...
[17:05:21 05] [Battlelog Cache] Performing lookupResponse #0...
[17:05:21 05] [Battlelog Cache] ResponseLoop locking lookupResponses (removing old response)
[17:05:21 05] [Battlelog Cache] ResponseLoop releasing lookupResponses (removing old response)
[17:05:21 05] [Battlelog Cache] Finished lookupResponse #0...
[17:05:21 05] [Battlelog Cache] Finished all lookupResponses...
[17:05:21 05] [Battlelog Cache] ResponseQueue empty, waiting...
[17:05:21 07] [Battlelog Cache] MySqlInsert for player 'Reverend9' with requestType 'Overview' successful!
[17:05:21 07] [Battlelog Cache] MySqlInsert finished!
[17:05:22 07] [Battlelog Cache] BattlelogLookup created WebClient...
[17:05:22 07] [Battlelog Cache] No personaId for player or requestType was clanTag...
[17:05:22 24] [Battlelog Cache] DownloadWebPage for URL 'http://battlelog.battlefield.com/bf3/user/Reverend9' took 0.17 seconds
[17:05:22 24] [Battlelog Cache] Extracting personaId...
[17:05:22 25] [Battlelog Cache] Extracting clanTag...
[17:05:22 25] [Battlelog Cache] clanTag is empty
[17:05:22 25] [Battlelog Cache] Performing requestType-lookup for personaId 517569938...
[17:05:23 70] [Battlelog Cache] DownloadWebPage for URL 'http://battlelog.battlefield.com/bf3/weaponsPopulateStats/517569938/1' took 1.45 seconds
[17:05:24 05] [Battlelog Cache] BattlelogLookup returning weaponStats...
[17:05:24 05] [Battlelog Cache] MySqlInsert starting!
[17:05:24 05] [Battlelog Cache] RequestLoop locking lookupResponses (adding new response)
[17:05:24 05] [Battlelog Cache] RequestLoop releasing lookupResponses (adding new response)
[17:05:24 05] [Battlelog Cache] RequestLoop locking lookupRequests (deleting old request)
[17:05:24 05] [Battlelog Cache] RequestLoop releasing lookupRequests (deleting old request)
[17:05:24 05] [Battlelog Cache] ResponseLoop active...
[17:05:24 05] [Battlelog Cache] ResponseLoop locking lookupResponses (creating local copy)
[17:05:24 05] [Battlelog Cache] ResponseLoop releasing lookupResponses (creating local copy)
[17:05:24 06] [Battlelog Cache] 1 lookupResponses in queue...
[17:05:24 06] [Battlelog Cache] Performing lookupResponse #0...
[17:05:24 06] CD - Reverend9: 0%
[17:05:24 06] [Battlelog Cache] ResponseLoop locking lookupResponses (removing old response)
[17:05:24 06] [Battlelog Cache] ResponseLoop releasing lookupResponses (removing old response)
[17:05:24 06] [Battlelog Cache] Finished lookupResponse #0...
[17:05:24 06] [Battlelog Cache] Finished all lookupResponses...
[17:05:24 06] [Battlelog Cache] ResponseQueue empty, waiting...
[17:05:24 06] [Battlelog Cache] Finished lookupRequest #0...
[17:05:24 06] [Battlelog Cache] Finished all lookupRequests...
[17:05:24 06] [Battlelog Cache] RequestQueue empty, waiting...
[17:05:24 06] [Battlelog Cache] MySqlInsert for player 'Reverend9' with requestType 'Weapon' successful!
[17:05:24 06] [Battlelog Cache] MySqlInsert finished!
[17:05:24 98] AdaptiveServerSize: IDLE -> 63 players online. 0 players joining. Server size set to 64. Round started at 64.
[17:05:34 22] [xVotemap] Info: Estimated voting start in 10 minutes @ 16:15:34
[17:05:34 28] AdaptiveServerSize: IDLE -> 63 players online. 0 players joining. Server size set to 64. Round started at 64.
[17:05:41 61] AdaptiveServerSize: IDLE -> 63 players online. 0 players joining. Server size set to 64. Round started at 64.
[17:05:50 78] AdaptiveServerSize: IDLE -> 64 players online. 0 players joining. Server size set to 64. Round started at 64.
[17:06:04 64] [xVotemap] Info: Estimated voting start in 10 minutes, 32 seconds @ 16:16:36
[17:06:04 72] AdaptiveServerSize: IDLE -> 64 players online. 0 players joining. Server size set to 64. Round started at 64.
* Restored post. It could be that the author is no longer active.
Link to comment

Originally Posted by GR101*:

 

Not sure if this is a problem or not, but I'm getting a lot of these messages?

 

Code:

[17:06:15 06]	[Battlelog Cache] Fetching stats for player 'SoullsReaper' with requestType 'Overview' failed!
[17:06:47 87]	[Battlelog Cache] Fetching stats for player 'TexHuK161' with requestType 'Weapon' failed!
[17:07:15 01]	[Battlelog Cache] Fetching stats for player 'fisnow' with requestType 'Overview' failed!
[17:07:16 34]	[Battlelog Cache] Fetching stats for player 'fisnow' with requestType 'Weapon' failed!
[17:07:49 05]	[Battlelog Cache] BattlelogLookup for player 'P0ldU' with requestType 'Weapon' failed!
[17:08:15 21]	[Battlelog Cache] Fetching stats for player 'Khernel' with requestType 'Overview' failed!
[17:08:16 55]	[Battlelog Cache] Fetching stats for player 'Khernel' with requestType 'Weapon' failed!
[17:08:44 98]	[Battlelog Cache] Fetching stats for player 'egotripper' with requestType 'Overview' failed!
[17:08:46 30]	[Battlelog Cache] Fetching stats for player 'egotripper' with requestType 'Weapon' failed!
[17:09:18 25]	[Battlelog Cache] Fetching stats for player 'Purplehazezzz' with requestType 'Weapon' failed!
[17:13:49 21]	[Battlelog Cache] Fetching stats for player 'Khernel' with requestType 'Weapon' failed!
[17:15:15 01]	[Battlelog Cache] Fetching stats for player 'Numil' with requestType 'Overview' failed!
[17:16:15 69]	[Battlelog Cache] BattlelogLookup for player 'Aadofzo' with requestType 'Overview' failed!
[17:16:17 11]	[Battlelog Cache] Fetching stats for player 'Aadofzo' with requestType 'Weapon' failed!
[17:23:50 10]	[Battlelog Cache] Fetching stats for player 'pradator513' with requestType 'Weapon' failed!
[17:32:16 86]	[Battlelog Cache] Fetching stats for player 'Overdriftx' with requestType 'Overview' failed!
[17:32:18 01]	[Battlelog Cache] Fetching stats for player 'Overdriftx' with requestType 'Weapon' failed!
[17:32:45 34]	[Battlelog Cache] Fetching stats for player 'zzzKEKCzzz' with requestType 'Overview' failed!
[17:32:46 75]	[Battlelog Cache] Fetching stats for player 'zzzKEKCzzz' with requestType 'Weapon' failed!
[17:35:45 34]	[Battlelog Cache] Fetching stats for player 'PostHaze' with requestType 'Overview' failed!
[17:35:46 66]	[Battlelog Cache] Fetching stats for player 'PostHaze' with requestType 'Weapon' failed!
[17:36:47 83]	[Battlelog Cache] Fetching stats for player 'Sunflesh' with requestType 'Weapon' failed!
[17:37:48 36]	[Battlelog Cache] Fetching stats for player 'PostHaze' with requestType 'Weapon' failed!
[17:39:45 95]	[Battlelog Cache] Fetching stats for player 'pcplasticfuzz' with requestType 'Overview' failed!
[17:39:47 31]	[Battlelog Cache] Fetching stats for player 'pcplasticfuzz' with requestType 'Weapon' failed!
[17:58:47 56]	[Battlelog Cache] BattlelogLookup for player 'BlackCobra-TR' with requestType 'Overview' failed!
[17:58:48 67]	[Battlelog Cache] Fetching stats for player 'BlackCobra-TR' with requestType 'Weapon' failed!
[18:19:23 21]	[Battlelog Cache] Fetching stats for player 'GoldsterJR' with requestType 'Overview' failed!
[18:25:01 24]	[Battlelog Cache] Fetching stats for player 'Saturn_VFB_' with requestType 'Weapon' failed!
[18:31:36 53]	[Battlelog Cache] BattlelogLookup for player 'Coxp' with requestType 'Overview' failed!
[18:32:34 05]	[Battlelog Cache] Fetching stats for player 'binky_sniper' with requestType 'Overview' failed!
[18:32:35 41]	[Battlelog Cache] Fetching stats for player 'binky_sniper' with requestType 'Weapon' failed!
[18:33:04 53]	[Battlelog Cache] Fetching stats for player 'swe_bee' with requestType 'Overview' failed!
[18:34:05 65]	[Battlelog Cache] BattlelogLookup for player 'swe_bee' with requestType 'Overview' failed!
[18:35:07 09]	[Battlelog Cache] Fetching stats for player 'jacky59810' with requestType 'Overview' failed!
[18:35:08 41]	[Battlelog Cache] Fetching stats for player 'jacky59810' with requestType 'Weapon' failed!
[18:36:10 80]	[Battlelog Cache] Fetching stats for player 'jacky59810' with requestType 'Weapon' failed!
[18:41:15 20]	[Battlelog Cache] Fetching stats for player 'Manmetschnor' with requestType 'Weapon' failed!
[18:45:46 70]	[Battlelog Cache] BattlelogLookup for player 'Batquina' with requestType 'Overview' failed!
[18:55:23 69]	[Battlelog Cache] BattlelogLookup for player 'Lofty87' with requestType 'Weapon' failed!
[18:58:20 08]	[Battlelog Cache] Fetching stats for player 'Sumzor_PL' with requestType 'Overview' failed!
[18:59:22 32]	[Battlelog Cache] Fetching stats for player 'Nogg0812' with requestType 'Weapon' failed!
[19:00:53 33]	[Battlelog Cache] Fetching stats for player 'Di3TerkE' with requestType 'Weapon' failed!
[19:11:19 53]	[Battlelog Cache] Fetching stats for player 'varroc187' with requestType 'Overview' failed!
[19:12:55 67]	[Battlelog Cache] BattlelogLookup for player 'KMBak' with requestType 'Weapon' failed!
[20:25:20 14]	[Battlelog Cache] BattlelogLookup for player 'NineTenJack' with requestType 'Overview' failed!
[20:25:21 47]	[Battlelog Cache] Fetching stats for player 'NineTenJack' with requestType 'Weapon' failed!
[20:26:22 98]	[Battlelog Cache] BattlelogLookup for player 'NineTenJack' with requestType 'Weapon' failed!
[20:26:49 62]	[Battlelog Cache] Fetching stats for player 'Silent2k11' with requestType 'Overview' failed!
[20:27:24 29]	[Battlelog Cache] BattlelogLookup for player 'EmmESt-iTa' with requestType 'Weapon' failed!
[20:31:19 60]	[Battlelog Cache] Fetching stats for player 'Krigerio' with requestType 'Overview' failed!
[20:31:20 94]	[Battlelog Cache] Fetching stats for player 'Krigerio' with requestType 'Weapon' failed!
[20:34:19 82]	[Battlelog Cache] Fetching stats for player 'Krigerio' with requestType 'Overview' failed!
[20:34:21 17]	[Battlelog Cache] Fetching stats for player 'Krigerio' with requestType 'Weapon' failed!
[20:35:19 57]	[Battlelog Cache] Fetching stats for player 'pitswd' with requestType 'Overview' failed!
[20:35:20 90]	[Battlelog Cache] Fetching stats for player 'pitswd' with requestType 'Weapon' failed!
[20:36:19 74]	[Battlelog Cache] Fetching stats for player 'Suv1' with requestType 'Overview' failed!
[20:36:21 07]	[Battlelog Cache] Fetching stats for player 'Suv1' with requestType 'Weapon' failed!
[20:37:50 58]	[Battlelog Cache] Fetching stats for player 'windowsVolkAn' with requestType 'Overview' failed!
[20:41:22 73]	[Battlelog Cache] Fetching stats for player 'Suv1' with requestType 'Weapon' failed!
[20:42:22 63]	[Battlelog Cache] Fetching stats for player '33EJ33-EW' with requestType 'Weapon' failed!
[20:43:53 00]	[Battlelog Cache] Fetching stats for player 'PaaainKiller' with requestType 'Weapon' failed!
[22:08:23 49]	[Battlelog Cache] BattlelogLookup for player 'LeftyRighty1' with requestType 'Weapon' failed!
[22:15:11 76]	[Battlelog Cache] Fetching stats for player 'jakubladyr' with requestType 'Weapon' failed!
[22:22:48 65]	[Battlelog Cache] Fetching stats for player '--reytr0--' with requestType 'Weapon' failed!
[22:23:46 80]	[Battlelog Cache] BattlelogLookup for player 'BimboGunner' with requestType 'Overview' failed!
[22:23:48 23]	[Battlelog Cache] Fetching stats for player 'BimboGunner' with requestType 'Weapon' failed!
[22:24:50 02]	[Battlelog Cache] Fetching stats for player 'BimboGunner' with requestType 'Weapon' failed!
[22:26:52 65]	[Battlelog Cache] Fetching stats for player 'Kellerman_pt' with requestType 'Weapon' failed!
[22:29:21 81]	[Battlelog Cache] Fetching stats for player 'rl-fate' with requestType 'Overview' failed!
[22:29:23 13]	[Battlelog Cache] Fetching stats for player 'rl-fate' with requestType 'Weapon' failed!
Thanks in advance
* Restored post. It could be that the author is no longer active.
Link to comment

Originally Posted by GR101*:

 

Hi.

 

Which debug level have you set in BC plugin?

 

Greets

Phil

Hi Phil,

 

It's currently set to debug 2 which I've had since day one, not sure whether that is the problem?

* Restored post. It could be that the author is no longer active.
Link to comment
  • 8 months later...

Archived

This topic is now archived and is closed to further replies.




  • Our picks

    • Game Server Hosting:

      We're happy to announce that EZRCON will branch out into the game server provider scene. This is a big step for us so please having patience if something doesn't go right in this area. Now, what makes us different compared to other providers? Well, we're going with the idea of having a scaleable server hosting and providing more control in how you set up your server. For example, in Minecraft, you have the ability to control how many CPU cores you wish your server to have access to, how much RAM you want to use, how much disk space you want to use. This type of control can't be offered in a single service package so you're able to configure a custom package the way you want it.

      You can see all the available games here. Currently, we have the following games available.

      Valheim (From $1.50 USD)


      Rust (From $3.20 USD)


      Minecraft (Basic) (From $4.00 USD)


      Call of Duty 4X (From $7.00 USD)


      OpenTTD (From $4.00 USD)


      Squad (From $9.00 USD)


      Insurgency: Sandstorm (From $6.40 USD)


      Changes to US-East:

      Starting in January 2022, we will be moving to a different provider that has better support, better infrastructure, and better connectivity. We've noticed that the connection/routes to this location are not ideal and it's been hard getting support to correct this. Our contract for our two servers ends in March/April respectively. If you currently have servers in this location you will be migrated over to the new provider. We'll have more details when the time comes closer to January. The new location for this change will be based out of Atlanta, GA. If you have any questions/concerns please open a ticket and we'll do our best to answer them.
      • 5 replies
    • Hello All,

      I wanted to give an update to how EZRCON is doing. As of today we have 56 active customers using the services offered. I'm glad its doing so well and it hasn't been 1 year yet. To those that have services with EZRCON, I hope the service is doing well and if not please let us know so that we can improve it where possible. We've done quite a few changes behind the scenes to improve the performance hopefully. 

      We'll be launching a new location for hosting procon layers in either Los Angeles, USA or Chicago, IL. Still being decided on where the placement should be but these two locations are not set in stone yet. We would like to get feedback on where we should have a new location for hosting the Procon Layers, which you can do by replying to this topic. A poll will be created where people can vote on which location they would like to see.

      We're also looking for some suggestions on what else you would like to see for hosting provider options. So please let us know your thoughts on this matter.
      • 4 replies
    • Added ability to disable the new API check for player country info


      Updated GeoIP database file


      Removed usage sending stats


      Added EZRCON ad banner



      If you are upgrading then you may need to add these two lines to your existing installation in the file procon.cfg. To enable these options just change False to True.

      procon.private.options.UseGeoIpFileOnly False
      procon.private.options.BlockRssFeedNews False



       
      • 2 replies
    • I wanted I let you know that I am starting to build out the foundation for the hosting services that I talked about here. The pricing model I was originally going for wasn't going to be suitable for how I want to build it. So instead I decided to offer each service as it's own product instead of a package deal. In the future, hopefully, I will be able to do this and offer discounts to those that choose it.

      Here is how the pricing is laid out for each service as well as information about each. This is as of 7/12/2020.

      Single MySQL database (up to 30 GB) is $10 USD per month.



      If you go over the 30 GB usage for the database then each additional gigabyte is charged at $0.10 USD each billing cycle. If you're under 30GB you don't need to worry about this.


      Databases are replicated across 3 zones (regions) for redundancy. One (1) on the east coast of the USA, One (1) in Frankfurt, and One (1) in Singapore. Depending on the demand, this would grow to more regions.


      Databases will also be backed up daily and retained for 7 days.




      Procon Layer will be $2 USD per month.


      Each layer will only allow one (1) game server connection. The reason behind this is for performance.


      Each layer will also come with all available plugins installed by default. This is to help facilitate faster deployments and get you up and running quickly.


      Each layer will automatically restart if Procon crashes. 


      Each layer will also automatically restart daily at midnight to make sure it stays in tip-top shape.


      Custom plugins can be installed by submitting a support ticket.




      Battlefield Admin Control Panel (BFACP) will be $5 USD per month


      As I am still working on building version 3 of the software, I will be installing the last version I did. Once I complete version 3 it will automatically be upgraded for you.





      All these services will be managed by me so you don't have to worry about the technical side of things to get up and going.

      If you would like to see how much it would cost for the services, I made a calculator that you can use. It can be found here https://ezrcon.com/calculator.html

       
      • 11 replies
    • I have pushed out a new minor release which updates the geodata pull (flags in the playerlisting). This should be way more accurate now. As always, please let me know if any problems show up.

       
      • 9 replies
×
×
  • Create New...

Important Information

Please review our Terms of Use and Privacy Policy. We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.