Duplicated weight name in networks.utils.mlp_layers

[emailweixu]

The dense layers created in mlp_layers have same names:

agents/tf_agents/networks/utils.py

Line 172 in 8231773

name='/'.join([name, 'dense']) if name else None))

Because of this, eager_utils.add_variables_summaries cannot generate summary for all the weights.

[oars]

Yeah, I actually just noticed this with V2 setups a day or two ago as well. It's an issue now that variables are not generated with unique names. They used to come from tf.Graph op names.

Looking at options to make them unique in V2.

[emailweixu]

@oars, this problem persists even with tf2.0 rc1. Now it's not just the problem of ml_layers. EnocdingNetwork also has this problem since EncodingNetwork creates the layers itself, Do you have any problem to fix it? It's quite confusing when I want to actually examine the values and gradients of those layers.