Make it so

Learning scala, hadoop, hive, spark, and kafka while obsessing over Animal Crossing

[patrickpstapleton]

Sticky

Hello, random tumblr user and/or fellow aspiring data scientists. I’m a former prep cook / pastry cook / technical writer learning big data programming with scala. Since I’m not really sure how to blog about that yet, this blog will soon be filled with links to resources for what I’m learning. I may also occasionally reblog something Animal Crossing related, and I may eventually figure out how to blog about what I’m learning.

I’m going to keep an index here so it’s easy to find my resource posts, since tumblr can be difficult to navigate. I’ll add links to resource posts as I make them.

Hortonworks Data Platform (HDP) Sandbox: post link

Spark SQL resource links here: post link

Agile / Scrum resource links here: post link

Planned future posts:

Big data

Scala

Python

SQL vs NoSQL

MongoDB

Hadoop

Hive

Spark

Kafka

[forest-playground]

some of my fave items from the update 📚🏯

[buginacup]

THE TYNK! DEMO IS LIVE!

This up and coming composer is showing her music to everyone who's anyone, regardless of how dangerous critical the feedback may be! You can play this completely normal game for free on Windows, Mac and Linux! Show your friends, show everybody! [PLAY NOW]

[buginacup]

New update just went up for Windows (and will come out soon for Mac and Linux) that fixes some bugs as well as adds some minor quality of life changes in the latter half. Save files are compatible so if you haven't beaten the demo yet it should be safe to use the new copy instead!

[patrickpstapleton]

Practice Questions: Spark SQL

https://hackr.io/blog/apache-spark-interview-questions

https://bigdatatrunk.com/top-spark-sql-interview-questions/

https://www.interviewgrid.com/interview_questions/bigdata_spark/bigdata_spark_sql

[ashendemon]

[crossingdesigns]

skyrim meme ✿ by gremlincrossing on twt

[patrickpstapleton]

Something to keep in mind if installing hadoop on ubuntu

http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/DeprecatedProperties.html

[patrickpstapleton]

Resource Links: HDP Sandbox

Because I keep having the same specific problems

https://www.cloudera.com/downloads/hortonworks-sandbox/hdp.html

^download here

https://www.cloudera.com/tutorials/learning-the-ropes-of-the-hdp-sandbox.html

^official beginners guide

https://maelfabien.github.io/bigdata/HortonWorks/

^unofficial beginners guide (note to self: this has the ssh thing)

https://stackoverflow.com/questions/29223588/ambari-name-node-startup-fails-when-safe-mode-is-on#29223650

^for when you get stuck in safe mode

https://community.cloudera.com/t5/Support-Questions/What-is-the-best-way-to-shut-down-Hortonworks-sandbox/td-p/173993

^ how to shut down safely

[tokopng]

gyroids.....!

[patrickpstapleton]

It rained on my island yesterday and so far I have found two gyroids that I did not plant myself!

[patrickpstapleton]

Resource Links: Agile / Scrum

https://www.northeastern.edu/graduate/blog/agile-vs-scrum/

^mostly text; explains agile and scrum and how they are related; has short descriptions of other project mgmt methodologies

https://www.scrum.org/resources/scrum-glossary

^ a glossary from “the home of scrum”

https://www.atlassian.com/agile/scrum/roles

^overview of scrum roles

https://www.cprime.com/resources/what-is-agile-what-is-scrum/

^ this one has infographics

https://objectivebased.blog/agile-development-team-roles-and-responsibilities/

^ a bit more in depth about roles and responsibilities

[patrickpstapleton]

Resource links: Spark SQL

https://www.edureka.co/blog/spark-sql-tutorial/

^spark sql basics; currently has an annoying popup

https://www.projectpro.io/article/spark-sql-for-relational-big-data-processing/355

^spark sql in the broader context of big data

https://data-flair.training/blogs/spark-sql-tutorial/

^beginners guide; part of a broader range of spark tutorials

https://spark.apache.org/docs/2.3.0/sql-programming-guide.html

^official source! has a lot of info about dataframes, datasets, and data sources

https://www.tutorialspoint.com/spark_sql/spark_sql_dataframes.htm

^specifically about dataframes

https://blog.taboola.com/spark-sql-score/

^this is about Schema on Read

https://medium.com/@subashsivaji/types-of-apache-spark-tables-and-views-f468e2e53af2

^ tables and views

[animalcrossingmemes]

[patrickpstapleton]

maybe I should get an icon/avatar of my ACNH character

[patrickpstapleton]

applying to use Twitter and Tumblr APIs for my project, but I didn’t realize the process was so complicated! I guess it makes sense that they would want to know who’s using their data, even if it’s from public posts

it’s just a practice project for work training, so I’m planning on looking at discussion around the recent Animal Crossing update announcement.

[patrickpstapleton]

hello! setting up a new tumblr for programming related stuff! hoping to share resources for the languages and technologies I’m learning for work. also interested in gamedev, but not sure if I want to keep my other blogs separate or not at the moment.