Skip to main content

One post tagged with "bigdata"

View All Tags

Big Data

· 7 min read
Vaughan Nothnagel
CryspIQ Inventor

A pragmatic business problem resolution perspective​

The hype cycle of big data has brought a number of single stream suggestions to bear in resolving the world’s insatiable appetite for information. There are 3 primary solution focus areas that show intent in solving the big data problem, each with their own specific benefit: -

  • Technology – Database fragmentation, Multi thread parallelism, Logical and Physical Partitioning;
  • Infrastructure – Processor Componentisation, Tiered Storage Provisioning, Hardwired Distributed Storage; and
  • Application – Data De-Normalisation & Aggregation, Read-ahead logic, Pre Process aggregation, Performance re-engineering.

The truth be told, each specific solution in isolation provides of itself an improvement opportunity and each will bring varying degrees of success to an organisations ability to handle the big data problem if, and only if, the right questions are asked. Only through this rigorous analysis and functional de-composition can one select the right method(s) for resolution to provide long term resolution as opposed to short term ‘disguising’ of the issue.