because Rocks.

Make a Statement! Life is interesting and there is so much to learn. Every part of life is fascinating. My life journey is about discovering and appreciating the different aspects of life.

[becauserocks]

I think escaping human limitations is a journey not a goal.

[becauserocks]

Connected by language

I’m working on a natural language process machine learning project.  Zipf’s law seems to come up all the time.  @vsauceblog​ has a nice video about it. Let’s test the law with because and try to show how we are all connected by language.

Zipf's law - states that given a large sample of words used, the frequency of any word is inversely proportional to its rank in the frequency table.

Quick lookup at http://www.wordcount.org/ we can see that because is ranked as 113. Looks like a common word.

Let’s proof Zipf’s Law. For a quick test I’ve used data from https://www.wordfrequency.info and Numbers on the mac to graph the data.  The data contains top 5000 words from an American English dataset.  

Here is how the data looks.

There are a lot of data points here and the scale is not the best. Hopefully, you can see the pattern of the data and that it follows the power law. You can see the R squared value in the left top corner. That shows how close the dataset matches the power law (between 0 and 1).  In data science you always want to see the same data from different vantage points.  Recognizing that it follows the power law we can switch the axis to use logarithmic scale.

Now we see something interesting. The data appears to follow a line.  

Here is the same dataset but looking at the first 50 words. It shows the power law a bit better.

and using logarithmic scale.

So lets test because! In the dataset because comes in at rank 89. And the first word the has the frequency of 22 million. An estimate using the above formula puts the because count at 247624 and the actual count in the dataset is 438539.  The size of the whole dataset is 520 million words.  The difference between the estimate and the actual values is 0.04%. This is almost the same.

The best part is that every (that we know of) language follows this pattern.

Here is an image from the “Zipf’s word frequency law in natural language: A critical review and future directions” https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4176592/

[becauserocks]

This old man!

Catching up on my anime. I love the meaning of life hidden in plain sight in this medium.

[becauserocks]

Brachistochrone - New Project

(Got that gif from the wiki full credit)

Got a great suggestion about how to use the steel marbles for a science project with the kids.  The Brachistochrone curve is the curve with the fastest descent.  This a perfect project to do with the kids.  @vsauceblog​ has a really nice video about it https://www.youtube.com/watch?v=skvnj67YGmw

[becauserocks]

Once this happens you know it is time to walk away from the computer.

[becauserocks]

In the park supervising Kids. Enjoying sweet, sweet non judgemental coffee at 8pm.

[becauserocks]

Got these marbles for a project I was thinking of doing with the kids.  Trying to teach them a bit of science before they go back to school.  What other fun projects I can use these marbles for?

[becauserocks]

1+2+3+4+...

I’ve always enjoyed a good series.  There are a lot of them out there.  The one that I really like is the infinite sum of natural numbers.  

Numberphile did a good job covering this series.

https://www.youtube.com/watch?v=w-I6XTVZXww

I like it because the unusual answer to this infinite series appears in physics.

The answer to the above series is -1/12

1+2+3+4+……. = -1/12

It is not easy to understand this results from mathematical point of view and trying to apply this to physics in string theory or quantum field theory requires suspension of disbelief.