跨区域 AWS Glue 连接

Question

我有什么: 在A地区拥有AWS Glue连接，在B地区拥有RDS MySQL数据库。我想配置AWS Glue访问该数据库。

我在两个地区之间建立了对等连接。安全组用于AWS Glue连接，符合VPC要求。安全组附加到数据库允许来自Glue连接所使用的子网的入站连接。它包含NAT网关和整个子网CIDR的规则。 error日志组的输出为：

ERROR StatusLogger Unrecognized format specifier [d]
ERROR StatusLogger Unrecognized conversion specifier [d] starting at position 16 in conversion pattern.
ERROR StatusLogger Unrecognized format specifier [thread]
ERROR StatusLogger Unrecognized conversion specifier [thread] starting at position 25 in conversion pattern.
ERROR StatusLogger Unrecognized format specifier [level]
ERROR StatusLogger Unrecognized conversion specifier [level] starting at position 35 in conversion pattern.
ERROR StatusLogger Unrecognized format specifier [logger]
ERROR StatusLogger Unrecognized conversion specifier [logger] starting at position 47 in conversion pattern.
ERROR StatusLogger Unrecognized format specifier [msg]
ERROR StatusLogger Unrecognized conversion specifier [msg] starting at position 54 in conversion pattern.
ERROR StatusLogger Unrecognized format specifier [n]
ERROR StatusLogger Unrecognized conversion specifier [n] starting at position 56 in conversion pattern.
ERROR StatusLogger No log4j2 configuration file found. Using default configuration: logging only errors to the console.
ERROR StatusLogger Unrecognized format specifier [d]
ERROR StatusLogger Unrecognized conversion specifier [d] starting at position 16 in conversion pattern.
ERROR StatusLogger Unrecognized format specifier [thread]
ERROR StatusLogger Unrecognized conversion specifier [thread] starting at position 25 in conversion pattern.
ERROR StatusLogger Unrecognized format specifier [level]
ERROR StatusLogger Unrecognized conversion specifier [level] starting at position 35 in conversion pattern.
ERROR StatusLogger Unrecognized format specifier [logger]
ERROR StatusLogger Unrecognized conversion specifier [logger] starting at position 47 in conversion pattern.
ERROR StatusLogger Unrecognized format specifier [msg]
ERROR StatusLogger Unrecognized conversion specifier [msg] starting at position 54 in conversion pattern.
ERROR StatusLogger Unrecognized format specifier [n]
ERROR StatusLogger Unrecognized conversion specifier [n] starting at position 56 in conversion pattern.

output日志组的输出结果为：

Check that your connection definition references your JDBC database with correct URL syntax, username, and password. Communications link failure

The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server.
Exiting with error code 30

我该如何找到网络链中错误配置的元素？我不确定连接错误是否与JDBC URL有关。

- Tarasovych

---

刚刚处理了类似的错误信息，尝试在同一区域设置Glue连接到Postgres RDS实例时，可能是JDBC驱动程序与引擎实例不兼容：https://www.repost.aws/questions/QUpkrhcfkYQtS2adbjpQ7quQ/cannot-connect-from-glue-to-rds-postgres。在我的情况下，我不得不从14降级到PostgreSQL Engine 13。 - zhanga

Answer 1

您可以在输出日志组中获得更详细的日志。默认情况下，测试连接链接将打开 /aws-glue/testconnection/error/<connection_name> CloudWatch 日志组。

点击 日志组 并打开 /aws-glue/testconnection/output/<connection_name>。

- zipate

Answer 2

对于遇到相同问题的人，这里有一些提示。我的使用情况是将Glue跨区域与Redshift无服务器连接。

• 确认区域A私有子网和区域B之间的VPC对等连接正常工作。
• Glue角色能够访问rds/redshift（Secrets Manager也可以）。
• Glue入站安全组设置为允许所有流量
• 入站安全组：允许redshift访问NAT弹性IP
• Glue Connection URL jdbc必须添加数据库名称，例如jdbc:xxx.com:5439/{database_name}

希望这些提示能够帮助到您。

- y2kmarkham