Top 10 Tools Every Analyst Should Have - Issue 103
Helpful tools and applications to have for data analysis and data science that can save you time and effort.
The difference between an experienced analyst and a beginner is that the former can effectively balance quality with speed. For many analytical projects where you can’t risk losing precision or confidence, you have to allocate a big chunk of time. For example, time-series forecasting, metrics calculations, or correlation analysis. In parallel, analysts always support the bulk of smaller projects like running EDAs, ad hoc requests, monitoring A/B tests, feature rollouts, or daily or weekly data reporting. These BAU projects are often repetitive, simple, and time-sensitive. It takes experience to recognize situations where you can afford to relax the significance and skip some steps to meet the deadline, or where you have to be very precise, careful, and meticulous.
This week I bring you a refreshed list of my favorite tools and applications that aim to save you time while working on smaller projects that are simple but possibly time-consuming. They can help you automate some repetitive tasks or serve as another source of data validation. Some of these are applications that have to be installed and configured, others are quick online tools and calculators.
🗄 Tools for data acquisition (IDE)
DataGrip is THE BEST database management system out there.
Why I like it:
Easy to install and connect all databases (PostgreSQL, Redshift, MySQL, SQLserver, SQLlite, MariaDB, Vertica, Hive, OracleDB, Snowflake, MongoDB, etc) to one client. As you know, many companies use more than one database, and structured and unstructured data can be distributed across multiple sources. DataGrip makes it easy to access and query different databases.
You can work on multiple consoles and run queries in different modes simultaneously.
It keeps a query history and activity log so you don’t lose anything.
It also serves as SQL file storage, giving you a quick way to access and open that one specific query that you worked on over 3 months ago.
It lets you explore schema navigation and view diagrams that show you how tables are connected and what the keys are
You can run a sophisticated EXPLAIN function that can give you a hint about how to improve your SQL performance.
It supports smart code completion, so you don’t have to remember every long_unintuitive_table_or_column_name, and it auto-completes names and keys for you! It also suggests the right keys to join tables. So cool.
It detects syntax errors and suggests options to fix them.
It has sophisticated refactoring. For example, if you rename a variable, it will update their usages through the entire file.
Integration with git and much more.
I’d highly recommend getting the license for this IDE for your team or using this client for your local database on your laptop. It makes my daily routine working with SQL so quick and efficient.
If you don’t have access to a database or a time/need to install one (for example, during a hackathon, home assignments, a competition, or technical interview where you have to analyze a chunk of data “on the fly”), Simpleql comes to help!
Keep reading with a 7-day free trial
Subscribe to Data Analysis Journal to keep reading this post and get 7 days of free access to the full post archives.