Commit Graph
241 Commits
Author SHA1 Message Date
Eric Blade 2790a623af import, code, exception cleanups 2009-09-15 21:07:31 -05:00
Eric Blade d6c5309aa3 clean up some module import code in fpdb_import 2009-09-15 20:10:18 -05:00
Eric Blade 715b14f81a moved timeout_add that calls do_import outside of the for loop, so it's only created once per autoimport start, not once per site. fix addImportFile to ignore files that don't exist (not sure how they'd get there, but just in case), fixed exception looking for fpdb_simple.DuplicateError to look in it's actual location at Exceptions.DuplicateError 2009-09-11 00:12:46 -05:00
Eric Blade 1f9dd8f8e9 HHC/fpdb_import: throw in some calls to gtk.main_iteration(False)
GuiBulkImport: replace "Importing" label with actual progressbar (does not use percentages, simply an activity bar)
2009-09-09 22:10:55 -05:00
Eric Blade 9fa57b6014 Database: re-write and fix drop_tables
Exceptions: add FpdbDatabaseError
SQL: default all tourneytypeids to 1
fpdb_import: import error tuples set to right size
2009-09-04 06:49:46 -05:00
Worros c350d62089 Fix typos 2009-09-03 15:44:28 +08:00
Eric Blade 63741468d0 removing "sending hand to hud" debug message 2009-08-30 12:45:02 -05:00
Matt Turnbull d2380ba738 merge from futz2 branch 2009-08-28 18:24:51 +01:00
Matt Turnbull 29a0ad85c7 full path to logging.config, small fix in Configuration.Database string repr 2009-08-15 22:36:14 +01:00
grindi bdfc6ef83f Unified locale handling.
Added support for importing filenames containig non-latin symbols
2009-08-12 21:55:19 +04:00
Matt Turnbull 222d713169 too much changes to go into master 2009-08-12 01:46:39 +01:00
sqlcoder d292cd18d4 Merge branch 'master' of git://git.assembla.com/fpdboz 2009-08-07 00:12:22 +01:00
sqlcoder 16319ea039 stop error when switching back from threads to 0 threads 2009-08-07 00:06:11 +01:00
sqlcoder c0ddaad2e5 remove test for msql drivers 2009-08-06 21:12:50 +01:00
Worros a37adde67e Catch up to Eric - fix markStreets regex 2009-08-06 11:30:21 +08:00
eblade 34c469ab3a Add AbsoluteToFpdb.py
Database: Add Absolute to sites
GuiPlayerStats: set avgseats to False
Hand: Add Absolute to SITEIDS list
fpdb_import: check for presence of settings['dropHudCache'] before testing it, to keep command line import from erroring
2009-08-05 21:07:16 -04:00
sqlcoder 61d2a83779 add hudcache option to Bulk Import tab 2009-08-04 21:41:04 +01:00
Worros ff2cca361c New insert player function for HHC import
Added getSqlPlayerIDs to Database.py - returns a hash {playername:sqlid}

Function uses a caching hash in Database.py to reduce the number of round trips to the database needed just to fetch the player ids for later inserts.

Need to do a performance comparison on a larger import.
2009-08-02 12:19:33 +08:00
Worros 40a0fe428b Variable name change - hhc is better imho 2009-08-02 11:03:35 +08:00
sqlcoder fbab3c7e24 make sure handsid is always returned and show size of queue when threaded 2009-08-01 00:07:31 +01:00
sqlcoder f3a4a8b0d0 fix previous merge 2009-07-31 22:30:41 +01:00
sqlcoder 8d77b961d7 merge from eric @6df03cb... 2009-07-31 22:07:27 +01:00
sqlcoder 36f09ebc82 merge from ray @f5ba0b5b7... 2009-07-31 21:58:39 +01:00
sqlcoder b503626c2b add db writer threading 2009-07-31 21:24:21 +01:00
eblade 6df03cb234 HUD_main: if new hand id int is not available, we can't print it, so that generates a second error, double fault
fpdb_import: ok, we're keeping two lists now, one with updated st_size and one with m_time.  grrr.
2009-07-31 01:15:28 -04:00
eblade f5ba0b5b7f Database: insert missing HandToWrite.payin_amounts var
EverleafToFpdb: remove DEBUG XXXXXXX line
FulltiltToFpdb: pass on converting tournament hands
Hand: add Hand.fee var that Database is looking for
fpdb_import: clean up file update scan code, queue files that have changed in the last 60 seconds for the next importer pass, instead of locking it up reading them now (not that this does anything since FT no longer updates the mtime until it closes the table, but maybe it works with Stars or others)
2009-07-30 21:50:08 -04:00
eblade 3ce0f91b27 useless change of a comment just to test my rss output 2009-07-30 19:53:44 -04:00
eblade 2c7e00f02a fpdb_import: use stat_info.st_size instead of stat_info.st_mtime to determine hh file updates 2009-07-30 17:29:57 -04:00
sqlcoder 38ee98e492 pass sql list from fpdb through guibulkimport to fpdb_import 2009-07-29 06:37:06 +01:00
sqlcoder 298de5dc15 move most stuff from fpdb_db.py to Database.py and simplify db connections in fpdb_import 2009-07-28 23:58:10 +01:00
sqlcoder 12e1da0a5e add lock_for_insert routine but comment out for now (hangs) 2009-07-28 21:19:31 +01:00
sqlcoder 859d18734c minor corrections to output messages 2009-07-25 17:39:06 +01:00
sqlcoder f69281e2fd finish hudcache rebuild code which speeds up bulk imports nicely - turn off permanently via allow_hudcache_rebuild in fpdb_import.py. Also some more moves into Database.py and cosmetic stuff 2009-07-21 22:26:23 +01:00
Worros d546557ef7 Make new db insert code "usable"
Next step, make the players insert. Function doesn't exist at the moment and crashes when NEWIMPROT set to true
2009-07-19 15:45:18 +08:00
Worros 34932c14ee Add index parameter to Plugins
Change constructor to HHC to accept an index arg, so that file reads can seek
2009-07-17 17:45:22 +08:00
Worros 61b0b8f4fe Prep work for inserting directly from HHC 2009-07-17 17:16:06 +08:00
Matt Turnbull 79ca83c95a Merge from ray, minor conflicts 2009-07-15 00:20:26 +01:00
Matt Turnbull dc6a1c45f9 sqlite - connecting and (re)creating some tables 2009-07-14 00:04:10 +01:00
sqlcoder a2db28ebf2 create Database instance in import to pass into parser - will eventually replace fpdb_db 2009-06-25 23:14:32 +01:00
Worros 22ff98d7c9 Remove passthrough section from import_file_dict 2009-06-20 14:02:03 +08:00
Worros f1921bebde Move functions from fpdb_save_to_db into Database.py
Doesn't actually do much cleanup.

Intend on moving all db functions into Database.py and fpdb_db.py and
providing and API, the functionality of fpdb_simple et all to shift into
the HHC
2009-06-20 04:15:52 +08:00
sqlcoder fdf4b65136 pass all settings through so that a new one can be used to skip updating hudcache (not used yet) 2009-06-20 03:21:24 +08:00
Worros ed9f02b113 Revert "pass all settings through so that a new one can be used to skip updating hudcache (not used yet)"
This reverts commit b935a5ad67.
2009-06-10 20:48:33 +08:00
sqlcoder b935a5ad67 pass all settings through so that a new one can be used to skip updating hudcache (not used yet) 2009-06-09 22:55:18 +01:00
sqlcoder 680e5c2f89 use new more flexible function to decide whether to drop indexes 2009-06-09 22:22:10 +01:00
Worros c3d2c5a2be Merge branch 'master' of git://git.assembla.com/free_poker_tools
Conflicts:

	pyfpdb/Database.py
	pyfpdb/SQL.py
	pyfpdb/fpdb_db.py
	pyfpdb/fpdb_save_to_db.py

Also fix datetime issue with Everleaf
2009-06-09 22:48:48 +08:00
sqlcoder 0a7c340656 Added timing info for index drop/create. Some small mods to output during import (obviously just change any you don't like) 2009-06-07 22:21:58 +01:00
sqlcoder e662279acd remove parameter to analyzeDB() (error in previous release) 2009-06-07 20:49:35 +01:00
sqlcoder 7e8b80948c move index etc functions from fpdb_simple.py into fpdb_db.py 2009-06-07 20:45:09 +01:00
Ray 109727e764 Postgres changes for unicode. 2009-06-06 11:17:49 -04:00