While many people here are saying the comparison is not fair because it's a single executor. The point being is that you don't always need that much computation, one VM today can do a lot more than what we can do in the past.

Having an embedded database is very powerful and requires much less infrastructure. If you need a one size fit it all solution, then Spark is probably still the best option.