Tag: databases

Extract, Transform, Load

I’ve been doing all kinds of data migrations and system integration for years now.  But only yesterday I’ve learned that there is a very specific term linked to the process.

In computing, extract, transform, and load (ETL) refers to a process in database usage and especially in data warehousing that:

  • Extracts data from outside sources
  • Transforms it to fit operational needs, which can include quality levels
  • Loads it into the end target (database, more specifically, operational data store, data mart, or data warehouse)

ETL systems commonly integrate data from multiple applications, typically developed and supported by different vendors or hosted on separate computer hardware. The disparate systems containing the original data are frequently managed and operated by different employees. For example a cost accounting system may combine data from payroll, sales and purchasing.

Tek Security Group’s Password Repository

Tek Security Group’s Password Repository

In this repository you will find helpful authentication brute forcing files. These files include known password defaults, usernames, common and specialized dictionaries, etc.

Backup black hole

I just had to look for something that got deleted in one of the systems I administrate.  We have daily backups for the last week, weekly backups for the last two month, monthly backups for the last year, and yearly backups for ever.  That seemed like a sensible backup plan.  Unfortunately, the item that I was looking for was deleted created and deleted a couple of weeks ago.  It probably made it into one of the daily backups, but got rotated out.  And it didn’t live long enough to get into the weekly backup.  And now it’s gone.

(It wasn’t anything critical – but it would be awesome to restore it anyway.)

If it was a file, a backup tool like HashBackup could have made sure I’d never lose it.  But it was an item in the database, of which I have a compressed dump.  I’m guessing it’s probably the time to look for a proper database backup tool…

Any recommendations for MySQL?