Feedback

It's not impossible. Learning a new language can be difficult at first. Although listening to podcasts is one of the keys to improve your level in a language, I think there are some things that you should also do. For example, choose a grammar book that you feel most comfortable with and continue writing here on LangCorrect. You don't have to spend hours everyday, you can spend like 30mins practicing English everyday. Remember consistency is the key. Since you listen to podcasts, there should be something called a transcript try reading it while listening. Also, try to pause and repeat after it. You could even record yourself and compare it with the audio. By doing this, you will improve your listening and speaking skills. You can also read books and articles of something you're interested in, it's totally normal to not understand everything being said. Underline the words that you don't understand and search them later on then put them in sentences. You could even write these sentences here to be corrected by native speakers.
I hope this helps!