How can I proceed when causal directions are not that clear? An example is provided I working with observational data and defining assumptions for DAG seems to be more complex than often in examples provided in textbooks. For me, it would be much easier to just skip DAG part and condition for everything, and probably there will be no problem in publishing. However, I like the idea of being explicit with my causal assumptions under methods.
I'll give a simplified example with only two predictors, and thus it would be easier to follow.
Background Information

*

*a crude analysis shows very clear multifold regional disparities in income between people from different towns

*variables or nodes like sex and age differ between towns (p < 0.05), indicating a need for adjusted analysis

*I have done different uni- and multi-level models with all kind of combinations of predictors and the result of regional disparities always holds.

DAG

Blue arrows seem to be okay for me; however, relationships between towns and sex/age are quite hard to define. I'll bring few, maybe stupid, examples

*

*town may be the cause of different sex distribution by offering more jobs for one sex (e.g. men and mining towns)

*sex may be a reason to change residence (e.g. local policies discriminate women and they move to another town)

*town may be polluted and shorten our expected living years (age)

*age may be a reason to change residence (e.g. moving to another town to go to university)

As you see, causal assumptions can be unidirectional (red, green) or bidirectional (orange), or is it even more reasonable to show them as undirectional (no arrows) (black)?
Goal

*

*As age and sex differed between towns, there will be a question about adjusted analysis. The goal is to use adjusted analysis to confirm the results of crude data analysis (to make them more bulletproof) - regional disparities between towns.

What would be the best way to achieve my goal?
For me, it seems that publishing the most conservative result would be reasonable since the result won't change with any adjusting.
What would be the most conservative adjusting?

*

*adjusting for everything, age and sex, and even if they may partially act as mediators (unknown direction or bidirectional arrows)?

*should I show a causal graph with undirected arrows (how should I name it then)?

*should I show a causal graph with bidirectional arrows (still named DAG?)

*am I right that undirected and bidirected arrows both make sex and age confounders due to opening a back-door path?

How would you solve and present this situation in your article?
 A: If you are not sure about the direction of the arrow, this is likely because you suspect (implicitly or explicitly) some potential confounding between the two variables. Hence, you should draw all plausible graphs and derive identifying assumption for each. For some you might reach the conclusion that your causal quantity of interest is not identifyable vis a vis available data, for others it might. With the DAGs you make clear under which causal assumptions a causal interpretation of your empirical estimand is internally consistent.
Generally speaking, the causal interpretation of an empirical estimand is based on the underlying causal model. That is, based on likely untestable assumptions. The DAGs are a tool to make this clear.
Bi-directed arrows are used in DAGs to indicate that there are unobserved back-door paths between two variables. You could also include this unobserved confounder explicitly, labelling it for instance $U$. This is just notational convention. However, assuming a bi-directed (or an unobserved confounder) changes, of course, the implications for identification.
A: Fist, I think it is good that you are using a DAG because it requires careful thought about causality, and this is often at the heart of modelling.

adjusting for everything, age and sex, and even if they may partially act as mediators (unknown direction or bidirectional arrows)?

One approach to this is to estimate the net effect for each variable that could either be a confounder or a mediator, and then adjust as appropriate. How you estimate the net effect is another question of course. You could also just make an assumption (and state the assumption in the paper).  Another idea is to fit several models where the variables are treated as either mediators or confounders and report the results of all. Since you only have 2 variables, Sex and Age, this seems like a reasonable approach; it would mean fitting 4 models.

should I show a causal graph with undirected arrows (how should I name it then)?

I would not do this, as it makes the diagram ambiguous.

should I show a causal graph with bidirectional arrows (still named DAG?)

I would not do this either, if you are fitting 4 models, as it would be inconsistent with the modelling. Also, you can't call it a DAG if it has bidirectional arcs (a DAG is dorected by definition)
I would include 4 DAGs.

am I right that undirected and bidirected arrows both make sex and age confounders due to opening a back-door path?

Not really, if you are following DAG theory, because the presence of an arc with no direction means that the graph is not directed and therefore is not a DAG.
