Cloudera News

• 

  Spark on Kubernetes – Gang Scheduling with YuniKorn
  • sorangutan  

  1
  1
  Posts
  65
  Views

  

  Apache YuniKorn (Incubating) has just released 0.10.0 (release announcement). As part of this release, a new feature called Gang Scheduling has become available. By leveraging the Gang Scheduling feature, Spark jobs scheduling on Kubernetes becomes more efficient. What is Apache YuniKorn (Incubating)? Apache YuniKorn (Incubating) is a new Apache incubator project that offers rich scheduling […]

  The post Spark on Kubernetes – Gang Scheduling with YuniKorn appeared first on Cloudera Blog.

  
  
  https://blog.cloudera.com/spark-on-kubernetes-gang-scheduling-with-yunikorn/
• 

  Streaming Market Data with Flink SQL Part I: Streaming VWAP
  • sorangutan  

  1
  1
  Posts
  44
  Views

  

  This article is the first of a multipart series to showcase the power and expressibility of FlinkSQL applied to market data. Code and data for this series are available on github. It was co-authored by Krishnen Vytelingum, Head of Quantitative Modeling, Simudyne. Speed matters in financial markets. Whether the goal is to maximize alpha or […]

  The post Streaming Market Data with Flink SQL Part I: Streaming VWAP appeared first on Cloudera Blog.

  
  
  https://blog.cloudera.com/streaming-market-data-with-flink-sql-part-i-streaming-vwap/
• 

  Driving Agility and Scalability through Smart Data
  • sorangutan  

  1
  1
  Posts
  39
  Views

  

  Last year presented business and organizational challenges that hadn’t been seen in a century and the troubling fact is that the challenges applied pains and gains unequally across industry segments. While brick-and-mortar retail was crushed a year ago with mandated store closures, digital commerce retailers realized ten years of digital sales penetration in only three […]

  The post Driving Agility and Scalability through Smart Data appeared first on Cloudera Blog.

  
  
  https://blog.cloudera.com/driving-agility-and-scalability-through-smart-data/
• 

  Managing Python dependencies for Spark workloads in Cloudera Data Engineering
  • sorangutan  

  1
  1
  Posts
  20
  Views

  

  Apache Spark is now widely used in many enterprises for building high-performance ETL and Machine Learning pipelines. If the users are already familiar with Python then PySpark provides a python API for using Apache Spark. When users work with PySpark they often use existing python and/or custom Python packages in their program to extend and […]

  The post Managing Python dependencies for Spark workloads in Cloudera Data Engineering appeared first on Cloudera Blog.

  
  
  https://blog.cloudera.com/managing-python-dependencies-for-spark-workloads-in-cloudera-data-engineering/
• 

  The New Releases of Apache NiFi in Public Cloud and Private Cloud
  • sorangutan  

  1
  1
  Posts
  19
  Views

  

  Cloudera released a lot of things around Apache NiFi recently! We just released Cloudera Flow Management (CFM) 2.1.1 that provides Apache NiFi on top of Cloudera Data Platform (CDP) 7.1.6. This major release provides the latest and greatest of Apache NiFi as it includes Apache NiFi 1.13.2 and additional improvements, bug fixes, components, etc. Cloudera […]

  The post The New Releases of Apache NiFi in Public Cloud and Private Cloud appeared first on Cloudera Blog.

  
  
  https://blog.cloudera.com/the-new-releases-of-apache-nifi-in-public-cloud-and-private-cloud/
• 

  #ClouderaLife Spotlight: Suzy Tonini, Talent Researcher
  • sorangutan  

  1
  1
  Posts
  21
  Views

  

  As we continue to work toward diversity, equality, and inclusion in every aspect of our company culture and beyond, we’ve learned so much from our employees’ unique perspectives on allyship. One such employee is Suzy Tonini, a Talent Researcher with a globe-trotting childhood. Growing up with parents who worked for the U.S. State Department, Suzy […]

  The post #ClouderaLife Spotlight: Suzy Tonini, Talent Researcher appeared first on Cloudera Blog.

  
  
  https://blog.cloudera.com/clouderalife-spotlight-suzy-tonini-talent-researcher/
• 

  Cable Companies Are Growing Up
  • sorangutan  

  1
  1
  Posts
  10
  Views

  

  Cable and Satellite companies in the US have emerged from a decade of acquisitions, consolidation and shakeout and are beginning to assert themselves as full service providers in the communications and media space. With Comcast just announcing its new suite of cellphone plans this month, and Charter, Altice and Dish ramping up their offerings, the […]

  The post Cable Companies Are Growing Up appeared first on Cloudera Blog.

  
  
  https://blog.cloudera.com/cable-companies-are-growing-up/
• 

  Converting HBase ACLs to Ranger policies
  • sorangutan  

  1
  1
  Posts
  21
  Views

  

  CDP is using Apache Ranger for data security management. If you wish to utilize Ranger to have a centralized security administration, HBase ACLs need to be migrated to policies. This can be done via the Ranger webUI, accessible from Cloudera Manager. But first, let’s take a quick overview of HBase method for access control. HBase […]

  The post Converting HBase ACLs to Ranger policies appeared first on Cloudera Blog.

  
  
  https://blog.cloudera.com/converting-hbase-acls-to-ranger-policies/
• 

  Relationship intelligence will shape the workplace of the future
  • sorangutan  

  1
  1
  Posts
  15
  Views

  

  Our latest Influential Women in Data session featured Brenda Le Sueur from Cambridge Assessments. Brenda has worked across many organisations and continents, but what has always been crucial to her is relationships – how we cultivate them, how we nurture them and how they, in turn, define us. I sat down with Brenda to ask […]

  The post Relationship intelligence will shape the workplace of the future appeared first on Cloudera Blog.

  
  
  https://blog.cloudera.com/relationship-intelligence-will-shape-the-workplace-of-the-future/
• 

  HDFS Data Encryption at Rest on Cloudera Data Platform
  • sorangutan  

  1
  1
  Posts
  17
  Views

  

  Introduction: Encryption of Data at Rest is a highly desirable or sometimes mandatory requirement for data platforms in a range of industry verticals including HealthCare, Financial & Government organizations. The capability increases security and protects sensitive data from various kinds of attack that could be internal or external to the platform. Access to HDFS data […]

  The post HDFS Data Encryption at Rest on Cloudera Data Platform appeared first on Cloudera Blog.

  
  
  https://blog.cloudera.com/hdfs-data-encryption-at-rest-on-cloudera-data-platform/
• 

  Apache Ozone and Dense Data Nodes
  • sorangutan  

  1
  1
  Posts
  25
  Views

  

  This post was co-authored by two Cisco Employees as well: Karthik Krishna, Silesh Bijjahalli Today’s enterprise data analytics teams are constantly looking to get the best out of their platforms. Storage plays one of the most important roles in the data platforms strategy, it provides the basis for all compute engines and applications to be […]

  The post Apache Ozone and Dense Data Nodes appeared first on Cloudera Blog.

  
  
  https://blog.cloudera.com/apache-ozone-and-dense-data-nodes/
• 

  The Intersection of Climate and Capital Markets
  • sorangutan  

  1
  1
  Posts
  15
  Views

  

  Happy Earth Day!  Earth Day was introduced in 1970 and has celebrated various milestone achievements including expanding globally and leveraging the power of social media to expand climate awareness and action. A great summary and history can be found on earthday.org/history. For those in financial services, climate initiatives are another major market event with far-reaching […]

  The post The Intersection of Climate and Capital Markets appeared first on Cloudera Blog.

  
  
  https://blog.cloudera.com/the-intersection-of-climate-and-capital-markets/
• 

  Drinking our own champagne – Cloudera upgrades to CDP Private Cloud
  • sorangutan  

  1
  1
  Posts
  20
  Views

  

  Like most of our customers, Cloudera’s internal operations rely heavily on data. For more than a decade, Cloudera has built internal tools and data analysis primarily on a single production CDH cluster. This cluster runs workloads for every department – from real-time user interfaces for Support to providing recommendations in the Cloudera Data Platform (CDP) […]

  The post Drinking our own champagne – Cloudera upgrades to CDP Private Cloud appeared first on Cloudera Blog.

  
  
  https://blog.cloudera.com/drinking-our-own-champagne-cloudera-upgrades-to-cdp-private-cloud/
• 

  #ClouderaLife Spotlight: Bogi Egyed, Engineering Manager
  • sorangutan  

  1
  1
  Posts
  18
  Views

  

  Meet Boglarka Egyed, also known as “Bogi” to her colleagues.  She’s a 5-year Clouderan who recently transitioned into the role of Engineering Manager.  Bogi originally graduated from college with her degree in Applied Mathematics but has spent her career as a Software Engineer. “Mathematics provided me with solid fundamentals to use in this field but […]

  The post #ClouderaLife Spotlight: Bogi Egyed, Engineering Manager appeared first on Cloudera Blog.

  
  
  https://blog.cloudera.com/clouderalife-spotlight-bogi-egyed-engineering-manager/
• 

  What is Streaming Analytics?
  • sorangutan  

  1
  1
  Posts
  15
  Views

  

  What is Streaming Analytics? Streaming Analytics is a type of data analysis that processes data streams for real-time analytics. It continuously processes data from multiple streams and performs simple calculations to complex event processing for delivering sophisticated use cases. The primary purpose is to present the most up-to-date operational events for the user to stay […]

  The post What is Streaming Analytics? appeared first on Cloudera Blog.

  
  
  https://blog.cloudera.com/what-is-streaming-analytics/
• 

  Deep Learning with Nvidia GPUs in Cloudera Machine Learning
  • sorangutan  

  1
  1
  Posts
  10
  Views

  

  Introduction In our previous blog post in this series, we explored the benefits of using GPUs for data science workflows, and demonstrated how to set up sessions in Cloudera Machine Learning (CML) to access NVIDIA GPUs for accelerating Machine Learning Projects. While the time-saving potential of using GPUs for complex and large tasks is massive, […]

  The post Deep Learning with Nvidia GPUs in Cloudera Machine Learning appeared first on Cloudera Blog.

  
  
  https://blog.cloudera.com/deep-learning-with-nvidia-gpus-in-cloudera-machine-learning/
• 

  What’s new in CDP Private Cloud Base 7.1.6?
  • sorangutan  

  1
  1
  Posts
  47
  Views

  

  According to IDG, when customers consider updating to the latest release of a product, they expect new features, enhanced security, and better performance, but increasingly want a more streamlined upgrade process.  With each new release of CDP Private Cloud, this is exactly what we strive to deliver.  Along with a host of new features and […]

  The post What’s new in CDP Private Cloud Base 7.1.6? appeared first on Cloudera Blog.

  
  
  https://blog.cloudera.com/whats-new-in-cdp-private-cloud-base-7-1-6/
• 

  No Data Loss and No Service Interruption – HDF to CFM Rolling Migration
  • sorangutan  

  1
  1
  Posts
  19
  Views

  

  The blog “Migrating Apache NiFi Flows from HDF to CFM with Zero Downtime” detailed how many common NiFi dataflows can be easily migrated when the Hortonworks DataFlow and Cloudera Flow Management clusters are running side-by-side. But what if you lack the resources to run multiple NiFi clusters concurrently?  Not a problem. Rolling migration — decommissioning […]

  The post No Data Loss and No Service Interruption – HDF to CFM Rolling Migration appeared first on Cloudera Blog.

  
  
  https://blog.cloudera.com/no-data-loss-and-no-service-interruption-hdf-to-cfm-rolling-migration/
• 

  Cloudera Data Engineering – Integration steps to leverage spark on Kubernetes
  • sorangutan  

  1
  1
  Posts
  20
  Views

  

  What is Cloudera Data Engineering (CDE) ? Cloudera Data Engineering is a serverless service for Cloudera Data Platform (CDP) that allows you to submit jobs to auto-scaling virtual clusters. CDE enables you to spend more time on your applications, and less time on infrastructure. CDE allows you to create, manage, and schedule Apache Spark jobs […]

  The post Cloudera Data Engineering – Integration steps to leverage spark on Kubernetes appeared first on Cloudera Blog.

  
  
  https://blog.cloudera.com/cloudera-data-engineering-integration-steps-to-leverage-spark-on-kubernetes/
• 

  Coffee with Cloudera – Gavin Welch, Sr. Partner Manager, IHVs
  • sorangutan  

  1
  1
  Posts
  7
  Views

  

  Meet Gavin Welch, Cloudera’s Partner Manager of the Year! Gavin leads the hardware alliances team and has made big strides in Cloudera’s relationship with Dell/EMC, launched a new strategic partnership with NVIDIA to help GPU acceleration for CDP-PvC Base, and recently became a first-time dad. Gavin’s the all-star quarterback everyone wants on their team, the […]

  The post Coffee with Cloudera – Gavin Welch, Sr. Partner Manager, IHVs appeared first on Cloudera Blog.

  
  
  https://blog.cloudera.com/coffee-with-cloudera-gavin-welch-sr-partner-manager-ihvs/