Analyzing Dev.to Git History with Elasticsearch
Joe Zack

Joe Zack @thejoezack

About: Programming, Podcasting, Real-time analytics

Location:
Orlando, FL
Joined:
Apr 8, 2018

Analyzing Dev.to Git History with Elasticsearch

Publish Date: May 7 '19
55 4

Importing Git History into Elasticsearch is not very much fun thanks to the lack of git formatting options, but it's pretty cool once you get it working!

The commits that I imported has 22 data points, including a one-to-many list of changed files. I imported the git history from dev.to to see how things looked.

Now I can run simple queries like this to see things like how many commits were made by each contributor:

Query for Commits by Author in Kibana Dev Tools

That's nice and all, but I'd prefer something visual so I put together a simple dashboard in Kibana.

This is a screenshot of the charts I put together. I can apply filters and searches at the top of the dashboard and it will affect all the charts.

Unfiltered dashboard

I can (for example) look at commits by Ben Halpern in the last 90 days that involve "Algolia".

Check out the video to see a bit more about the visualizations:

Pretty cool right?

Conclusion

Eventually I'd like to take some time to clean-up the import process so it's easier to run, but for now I'm going to take some time exploring a couple of my own projects to see if I can dig anything interesting up.

Comments 4 total

  • Boris Jamot ✊ /
    Boris Jamot ✊ /May 7, 2019

    Pretty nice job. Your video is also awesome.

    I guess the goal of this article is more about elasticsearch and kibana than about dev.to's git history, because github already has this kind of feature about git's statistics, right?

    • Joe Zack
      Joe ZackMay 7, 2019

      Yeah, I was just having some fun :)

  • Stephen Charles Weiss
    Stephen Charles WeissMay 9, 2019

    Hey Joe -

    Just FYI the image links seem to be dead.

    • Joe Zack
      Joe ZackMay 10, 2019

      Ack! Thanks, I changed domain names :)

      I'll get it fixed up

Add comment