I know that some of the fault is mine, but I didn't had buildings blocking my signal, I had one, but it didn't block my signal, the moment the drone lost signal I could clearly see the drone.
Plus, the rth shouldn't be immediately. And you should be able to disable rth or at least set a timer...