Requirement:

1 billion records to be inserted every day
180 days data to be maintained
180 * 1 billion records = approx no of records = defines the size of the
database

Need to design the database/process to maintain so huge data?


- R

Hi Rakesh,

Need more info like an idea of the number of tables, size of rows, querying
which will reflect what indexes are required etc...

You will need some good kit though, lots of disks; what sort of fault
tolerance are you looking at because backups are going to be a problem.

Show quoteHide quote

With an average row size of 100 bytes, this calculates to about 18 TB of
usable space not including index overhead.  You'll also need to sustain a
rate of over 10 thousand inserts per second 24x7.

Very large tables are often partitioned for manageability reasons and to
address backup issues like Tony mentioned.  Attention to detail is very
important.  Unless you have experience working with very large databases, I
suggest you engage consultants with VLDB experience to help you out.  We can
help you with specific questions but a project of such magnitude requires
dedicated resources with specialized experience.

Show quoteHide quote

can't delete a row from primary table - is there an SP for this?
Ranking Rows
simple trigger question
Self-referencing UPDATE Statement on a single field
IF-ESLE TO Detemine WHERE Clause