Should I wish him a happy holidays?

yes, call to tell him that but nothing else, you already laid your cards on the table and he did not go for it, so save your pride and wish him a happy new year too and maybe he will ask you out, good luck