You're right, of course, but just as you could easily say that in several years, we could be in the worst position in the NBA, you could also easily say we'll be in the best.
For example: If we're in the worst place in the NBA in the next 5 years, how? Well, we could trade all our first round picks for trash players (Hill standards), trade AD to the Lakers for Rondo and McGee, trade Jrue for Corey Brewer, and be absolute sewage.
But say we take the NYK trade, get Zion, then he's all he's cracked up to be, Robinson learns how to not foul, DSJ's recent resurgence in NY is legitimate, and Knox becomes more efficient from the floor, the Mavs crash as Porzingis never comes back the same so we get another top 5 pick in 2021. That's best case scenario.
So depending on the luck, we could either be the number 1 or the number 30 team in 5 years. Odds are is that the luck will fall somewhere in the middle of that. We just have to do the best we can executing on our plan. Of course it could go wrong, but it could go wrong for anyone. Next week, Curry's ankles shatter again and then this summer, Klay and KD walk. All of a sudden GS are a lottery team.