Passing ref to directive binding makes `Maximum recursive updates exceeded`

Question

I want to create a directive in Vue3 and using composition API. I also want to pass ref to another element as binding to my directive. So I have written the following piece