Tag: spark
Posts of Tag: spark
  1. An Introduction to Apache Spark with Java

    An Introduction to Apache Spark with Java What is Apache Spark? Apache Spark is an in-memory distributed data processing engine that is used for processing and analytics of large data-sets. Spark presents a sim...Learn More
    JavaApachespark
  2. Understanding Spark As If You Had Designed It

    Understanding Spark As If You Had Designed It From a simple function to a resilient and distributed framework. Why caring about Spark? Among the current frameworks available on the data space, just a few hav...Learn More
    Newssoftware developmentsparkBig DataSoftware ArchitectureDistributed Systems
  3. Insane DJI Spark RC Mod | Drones

    Got Range? One of the many things that separate the Spark from other drones in the DJI consumer line of aircraft is limit in range. DJI states that the video transmission signal has an unobstructed LOS range o...Learn More
    NewssparkDronesDjiMods
  4. Structured Streaming

    Structured Streaming Introduction As streaming frameworks are emerging gradually, it encourages the developers to concentrate on business challenges rather than focussing on potential streaming analytics issu...Learn More
    NewssparkBig DataHadoopReal Time AnalyticsSpark Streaming
  5. Install Pyspark and use GraphFrames on macOS and Linux

    Install Pyspark and use GraphFrames on macOS and Linux Detail Guide on How to Install Pyspark and use Spark GraphFrames on different OSs Linux(Ubuntu) All the following operations should be done under Termin...Learn More
    NewssparkInstallationSpark Graphframe
  6. Flight Data Analysis Using Spark GraphX

    Spark GraphX Tutorial — Edureka GraphX is Apache Spark’s API for graphs and graph-parallel computation. GraphX unifies ETL (Extract, Transform & Load) process, exploratory analysis and iterative graph computat...Learn More
    Newsdata sciencesparkBig DataApache SparkGraphx
  7. Accessing Kerberized Sources From Spark2 In Cluster Mode On Yarn

    Introduction Many of phData’s customers face the issue that they need to connect to a source secured via Kerberos in a Spark application. A source can be a JDBC connection like Impala, or a web URL that uses K...Learn More
    NewssparkBig DataKerberos
  8. Introduction to Apache Spark with Scala

    This article is a follow-up note for the March edition of Scala-Lagos meet-up where we discussed Apache Spark, it’s capability and use-cases as well as a brief example in which the Scala API was used for sample...Learn More
    Newsdata sciencesparkBig DataApache SparkScala
  9. Video: On a Highway to Scale — Machine Learning as a Platform (Hebrew)

    On a Highway to Scale: Machine Learning as a Platform — Ben Amir (Hebrew) When you’re handling lots of data, you come across many issues and problems, including ones associated with model training. At Riskifie...Learn More
    Machine LearningNewssparkEngineeringVideosApache Spark
  10. Improving the scalability of a Spark pipeline for conversion attribution

    Rohil Bhansali | Software Engineer, Business & Creators Many Pinners use Pinterest with a planning mindset and often have commercial intent. Advertisers use Pinterest to reach those Pinners, and Pinterest offe...Learn More
    NewssparkBig Data
  11. Deep-dive into Spark internals and architecture

    Apache Spark is an open-source distributed general-purpose cluster-computing framework. A spark application is a JVM process that’s running a user code using the spark as a 3rd party library. As part of this b...Learn More
    ProgrammingNewsTechnologydata scienceartificial intelligencespark
  12. This week in #Scala (March 4, 2019)

    This week in #Scala (March 4, 2019) Welcome to the new edition of #ThisWeekInScala! This blog aims to keep you up to date with the latest news from the world of Scala and Reactive programming. It has been a ...Learn More
    NewssparkDistributed SystemsScalaFunctional ProgrammingThisweekinscala