I have known a lot of rich people. The common denominator among almost all of them [if not all] was that they really cared about and even loved money. Otherwise, you don't become rich. You work the minimum and go home.
You want to become a serious Torah scholar? You want to become fluent in being able to read Gemara, Rashi, Tosfos and other sfarim? You want Torah to be EXCITING, BREATHTAKING, INTOXICATING? It takes HARD WORK and SACRIFICE. And you have to REALLY CARE.
אִם־תְּבַקְשֶׁ֥נָּה כַכָּ֑סֶף וְֽכַמַּטְמוֹנִ֥ים תַּחְפְּשֶֽׂנָּה׃
If you seek it as you do silver and search for it as for treasures,
אָ֗ז תָּ֭בִין יִרְאַ֣ת יְהוָ֑ה וְדַ֖עַת אֱלֹהִ֣ים תִּמְצָֽא׃
Then you will understand the fear of Hashem and attain knowledge of Hashem. [Mishlei 2-4/5]
Torah is דעת א-להים and thus requires that you go for it like rich people go for money.
But if a person wants to have his cup of coffee, some cake and cookies, recline in a lazy boy chair and hear a cute vort here and there - his life will be easier but far less meaningful and fulfilling.