Actually is often used in speaking as a discourse marker. We use it to indicate a new topic of conversation or a change or contrast in what is being talked about. We also use actually to give more detail about a topic. We do not use it to refer to time:
I suppose you’re going away this weekend?
Actually, I am going to stay at home. I’ve got a lot of work to do on the computer.
[a customer (A) in a large bookshop is asking about books about travel.]
Could you tell me where your books on Austria are kept?
What kind of books?
Well, actuallyI’m looking for a book on skiing in Austria.