You can say 'to be frank' or 'to be frank with you' to introduce a statement which is your honest opinion, especially when the person you are talking to might not like it.
[spoken] To be frank, he could also be a bit of a bore.
To be frank with you, Harvey, I may have made a mistake.