You are not imagining it and you are not being difficult. Document it and take the document in.

Ask for the longer appointment slot. Ten minutes is not enough for a complex history and pretending otherwise wastes both your time.

Small wins count. Walking to the mailbox is a data point.

Log dose, time and sleep. Ten seconds a day and it turns the anecdote into something you can look at.

Written confirmation email after every phone call. Cheapest insurance there is.