13M rows in the history table (in General)


AdminJonathan May 12 2005 11:16 AM EDT

Think I'd better have a look.

Arorrr May 12 2005 11:20 AM EDT

First and what?

Nixon Jibfest May 12 2005 11:22 AM EDT

Second and huh?

AdminJonathan May 12 2005 11:34 AM EDT

you know, the data that CB uses to draw those pretty graphs

Sukotto [lookingglas] May 12 2005 11:45 AM EDT

How quickly is it growing?

Perhaps keep the last X days of real data, then only record a trend or average number for each previous $timeperiod. Say... daily for the last 90 days, and a weekly average for previous dates?

Special J May 12 2005 11:50 AM EDT

Wow, give your db server a hug from me, 13m rows and it doesn't cough and die on a request?

Hell of a coding job Jon.

AdminJonathan May 12 2005 11:50 AM EDT

nah, it's smarter than that

only I was doing min() instead of max(), oops.

AdminJonathan May 12 2005 11:51 AM EDT

postgresql is tough enough to withstand even stupid mistakes like that one :P

it was starting to play hell with the cache though, which is what made me suspicious

Special J May 12 2005 11:56 AM EDT

Yes I've started to consider pqsql instead of mysql on a couple of coming jobs, the only issue is the person who will maintain the DB hasn't a clue on pgsql.

And they are not paying me enough to teach him anything.

NotSuitablForChildren [Yeeeaahh.................] May 12 2005 11:57 AM EDT

Hell of a coding job Jon.

--mrwuss, 11:50 AM EDT

I would have to agree. I wish some other game developers would drop by the site and take some notes. :)

AdminJonathan May 12 2005 12:04 PM EDT

pgsql doesn't need "maintenance," it's not like Oracle that way... if you let apt install it on debian it even sets up autovacuum for you.

you would want to spend half an hour or so going through postgresql.conf and increasing the amount of memory you let PG grab for various activities, though. the defaults are excessively conservative.

then again if your app is small enough you might not even need to bother with that much.
This thread is closed to new posts. However, you are welcome to reference it from a new thread; link this with the html <a href="/bboard/q-and-a-fetch-msg.tcl?msg_id=001Kvq">13M rows in the history table</a>