I attended a Meetup yesterday in Mountain View, hosted by The Hive group on
the subject of Lambda Architecture. Since I had never heard about this new
phrase, my curiosity took me there. There was a panel discussion and
panelists came from Hortonworks, Cloudera, MapR, Teradata, etc.
Lambda Architecture is a useful framework to think about designing big data
applications. Nathan Marz designed this generic architecture addressing
common requirements for big data based on his experience working on
distributed data processing systems at Twitter. Some of the key requirements
in building this architecture include:
Fault-tolerance against hardware failures and human errors Support for a
variety of use cases that include low latency querying as well as updates
Linear scale-out capabilities, meaning that throwing more machines at the
problem should help with getting the job d... (more)
Big Data Coverage at CES 2015
I saw more discussion on big data at CES 2015 this week, compared to previous
years. Everyone talked about data as the central core of everything. The IoT
(Internet of Things), NFC (near Field Communication) and M2M (Machine to
Machine) communication are enabling pieces for many industries - security
monitoring, asset and inventory tracking, healthcare, process control,
building environment monitoring, vehicle tracking and telemetry, in-store
customer engagement and digital signage. Big data is the big deal here.
The Big Data ecosystem includes - cl... (more)
Data Lake and Data Refinery – Gartner Controversy!
Much discussion has been going on the new phrase called Data Lake. Gartner
wrote a report on the ‘Data Lake’ fallacy, saying to be careful about
‘data lake’ or ‘data swamp’. Then Andrew Oliver wrote in the
InfoWorld these beginning words, “For $200, Gartner tells you ‘data
lakes’ are bad and advises you to try real hard, plan far in advance, and
get governance correct”. Wow, what an insight!
During my days at IBM and Oracle, Gartner wanted to get time on my calendar
to talk about database futures. Then afterwards, I realized that... (more)
The World of Hadoop and Beyond
Hortonworks went through an IPO last Friday, December 12, 2014. It’s
initial price of $16 soared by 60% immediately after. Today the stock price
is $24.70 with a market cap of $1.02B. Another billion dollar club member.
They compete with Cloudera and MapR in packaging the open source Hadoop
platform for customers. How do they make money when the basic Apache Hadoop
is free? – by offering added services like training and consulting. They
can also add auxiliary products (not open source) that customers must pay
for. The interesting fact is that Horto... (more)
This year’s CES expects to have 160,000 attendees and tonight’s keynote
by the CEO of Samsung Mr. BK Yoon was “unlocking infinite possibilities of
IoT”. The Internet of Things seems to be the overall theme this year.
Today I listened to an interesting panel on disruptive technologies over next
five years. Here is a brief summary.
3D Printing: This year expects to see 300,000 desktop 3D printers in the US.
Mainstream consumer adoption is doubtful. Someone jokingly said that you can
build a statue of yourself and install it in your yard. Another term for 3D
printing is additive ma... (more)