Databases Reference
In-Depth Information
In another case, AutoSupport was unable to run a pattern-matching query that would help detect
bugs. The report required a query of 240 billion records, which was simply too large to run with the
existing infrastructure. Through performance testing on the NetApp Open System for Hadoop, the
team was able to run the high-bandwidth query and achieve results in less than 18 hours, using just
ten data nodes.
Impact: rich analytics for large data sets
AutoSupport provides skilled resources focused on supporting NetApp customers through analyzing
log data for insight into system health. The NetApp Open Solution for Hadoop system enables paral-
lel processing for structured and unstructured data and allows AutoSupport applications to work with
thousands of nodes. Weekly AutoSupport logs composed of large, complex data sets offer the team
insight into information such as storage capacity trending by customer, country, and other criteria.
The team also runs ad-hoc queries such as investigating an error alert across an entire system
set to identify the source, allowing the team to take proactive measures to prevent impact to cus-
tomer systems. In addition, through automatic AutoSupport system analysis of deep pools of data, the
NetApp Technical Support team is immediately notified of critical alerts. The NetApp Open Solution
for Hadoop is designed to accelerate these and other AutoSupport queries and processes.
NetApp customers can also benefit directly from the high performance of the NetApp Open
Solution for Hadoop system, which offers deeper analytics capabilities than before. With more
in-depth visibility into configuration and system health data through the My AutoSupport portal,
customers can be more proactive and achieve greater efficiencies with their NetApp storage.
Impact: managing a holistic storage environment
The AutoSupport team will efficiently manage its Big Data environment centrally on the NetApp
Open Solution for Hadoop system. The solution will provide high levels of throughput and scal-
ability to meet the growing data demands and intensive performance requirements of AutoSupport
applications. Storage managers can efficiently manage huge stores of data in the integrated, unified
AutoSupport storage environment, which helps NetApp customers optimize the performance and
utilization of their storage solutions.
“The NetApp Open Solution for Hadoop is a holistic rather than point solution,” said Kumar
Palaniappan, enterprise architect for NetApp. “By design, the NetApp solution offers tight integra-
tion between our Hadoop applications and NetApp storage, thereby allowing us to maximize storage
utilization and reduce our overall capex and opex. Hadoop analytics will empower us to transform
NetApp storage data into business insight for our team and customers.”
Key highlights
Technologies
●
Hadoop platform: NetApp Open Solution for Hadoop
●
Storage systems: NetApp E2600 and FAS2040 HA
●
Operating system: Data ONTAP 8.0
●
Protocols: NFS and SASL
