Untitled

[codefiy]

Week 3: Peer graded assignment

Contributed By : Gauravpreet Singh 1-import-library.jpgDownload 2-parquet-to-csv.jpgDownload 3-converted-parquet.jpgDownload 4-accuracy-model-lr 5-pmml.jpgDownload 6-deploy_wml_pmml.jpgDownload 7-model-inference.jpgDownload 8-hyper-parameter-tuning.jpgDownload 9-resample-data-splits.jpgDownload randomforest

View On WordPress

[codefiy]

0.20707853485315178

View On WordPress

[codefiy]

WEEK 2:  SparkML

1) Select the best definition of a machine learning system. -> A machine learning system applies a specific machine learning algorithm to train data models. After training the model, the system infers or “predicts” results on previously unseen data. 2) Which of the following options are true about Spark ML inbuilt utilities? -> Spark ML inbuilt utilities includes a linear algebra package. ->…

View On WordPress

[codefiy]

WEEK 1:  Spark for Data Engineering

1) Select the option where all four statements about streaming data characteristics are correct. -> Data is generated continuously; often originates from more than one source; is unavailable as a complete data set; requires incremental processing. 2) Select the data sink option that is not fault-tolerant and that is recommended for debugging only. -> Console and Memory 3) Select the answer…

View On WordPress

[codefiy]

Introduction to Big Data with Spark and Hadoop

week 1 week 2 week 3 week 4 week 5 Week 6 (Final Exam)

View On WordPress

[codefiy]

WEEK 6:  FINAL  EXAM

1) Which of the following Apache Spark benefits helps manage big data processing? -> Unified framework 2) One component of Spark architecture is the executor. Which of the following is true? -> Executors complete single tasks 3) Select the characteristics of datasets. -> Strongly-typed; use unified Java and Scala APIs; built on top of DataFrames; are the latest data abstraction added to…

View On WordPress

[codefiy]

WEEK 6:  Introduction to Monitoring & TuningWEEK  

1) Select the option that includes the available tabs within the Apache Spark User Interface. -> Jobs, Stages, Storage, Environment, Executor, and SQL 2) Which action triggers job creation and schedules the tasks? -> The collect() action 3) Syntax, serialization, data validation, and other user errors can occur when running Spark applications. View the numbered list and select the option that…

View On WordPress

[codefiy]

WEEK 5:  Spark Architecture

1) A Spark application has two processes, driver and executor process. Where can the driver process be run? Select all that apply. -> Cluster node -> Another machine as client to the cluster 2) The Cluster Manager communicates with a cluster to acquire resources for an application. Which type of Cluster Manager is recommended for setting simple clusters? -> Spark Standalone 3) The…

View On WordPress

[codefiy]

WEEK 4:  Introduction to Data-Frames & SparkSQL

1) Select the statements that are true about a Directed Acyclic Graph, known as a DAG. -> If a node goes down, Spark replicates the DAG and restores the node. -> Every new edge of a DAG is obtained from an older vertex. -> In Apache Spark, RDDs are represented by the vertices of a DAG while the transformations and actions are represented by directed edges. -> A DAG is a data structure with…

View On WordPress

[codefiy]

WEEK 3: Introduction to Apache Spark

1) Apache Spark uses distributed data processing and iterative analysis. Parallel and Distributed computing are similar. What is the difference between these computing types? -> Parallel computing utilizes shared memory -> Distributed computing utilizes each processors own memory 2) Which of the following statements define functional programming? -> Emphasizes "What" instead of…

View On WordPress

[codefiy]

WEEK 2: Introduction to Hadoop

1) MapReduce has two tasks, map and reduce. Together, what do these two tasks do? -> Creates a unique key 2) Which external component is the first stage of operation in the Hadoop ecosystem? -> Ingest data 3) Nodes are single systems that are responsible for storing and processing data. Which node is known as a data node in HDFS? -> Secondary node 4) What is the maximum data size Hive can…

View On WordPress

[codefiy]

WEEK 1:  Introduction to Big Data

1) Which of these statements describe big data? Check all that apply. -> Data generated in huge volumes and can be structured, semi-structured, or unstructured. -> Big Data arrives continuously at enormous speed from multiple sources. 2) Select the options that illustrate use of big data technologies. -> Personal assistants including Google, Alexa, and Siri -> IOT Systems -> Social media…

View On WordPress

[codefiy]

Introduction to NoSQL Databases

Graded Quiz Week 1 Week 2 Week 3 Week 4 Week 5 Final Assignment project

View On WordPress

[codefiy]

Week 5: Peer-Graded Final Assignment of Working with NoSql Databases

download all final assignment jpg fileDownload    Week 1  Week 2  Week 3  Week 4  Week 5  Week 6  

View On WordPress

[codefiy]

Week 5: FINAL QUIZ OF INTRODUCTION TO NoSQL

1) Which factor drives the data model in a NoSQL database?      The queries you intend to make 2) What is one way that a distributed NoSQL database usually shards data?      NOT SURE 3) In the ACID model what does it mean for the data to be “durable”?      NOT SURE 4) Which of the following makes NoSQL databases most appropriate for use with cloud computing?    Their distributed nature makes…

View On WordPress

[codefiy]

Week 4:  Cloudant Basics

1) Which IBM Cloudant capability helps you most to develop custom apps?       Language-specific libraries 2) How are IBM Cloudant users routed to data centers?       Ping timing 3) What are the two primary reasons that documents are organized into databases in IBM Cloudant?     For security and querying 4) With which IBM Cloudant deployment option plan is there a maximum limit of 1MB for a…

View On WordPress

[codefiy]

Week 3:  Cassandra Basics 

1) Cassandra is a best fit for use cases that have which characteristic?       Always available 2) What does data distribution start with?       A query 3) What is a consequence of Cassandra’s availability?      Possible inconsistency of the changed data 4) What are two logical entities in the Cassandra data model?      Tables and keyspaces 5) Which guideline should you follow for modeling…

View On WordPress