OP, There is no 180 day rule.
However as correctly pointed out above , the io may question why you are not using non O with extension and reentry permit.
However you mention "2 or 3 times per year"
Zero issues with that.
Many tourists visit far more often than that each year.