Big data UX depends on improved visualization and analysis tools

I'm busy trying to find a better tool set  for analysing large, complex semi-structured data sets.

Customers and solution providers all too often specify solution requirements based on a prescribed outcome.

list x, y, z.
count x
average of q

Historically this has led to very result orientated and data dense applications.  Customers are now starting to understand that big data has downstream implications for End users.

Users still need the tools for analysing  dense data at a microscopic level, however to successfully exploit large datasets users need advanced UI visualizations that enable them to comprehensively understand the structure of their data at a macro level.

Tools I've seen demonstrated for this include Association graphs, subject maps, hot spot maps.