Welcome to OGeek Q&A Community for programmer and developer-Open, Learning and Share
Welcome To Ask or Share your Answers For Others

Categories

0 votes
285 views
in Technique[技术] by (71.8m points)

amazon web services - AWS DMS doesn't upgrade int to double while using mongoDB as source

I am trying to load data into S3(parquet files) from mongoDB using AWS Data Migration Service(DMS). One particular collection has a field which has data type Integer in some documents and Double in other documents.

DMS scans the collection and writes data to parquet files.

Then I run a Glue crawler to generate tables for AWS Athena. The table for this collection gets created with field's data type as integer, and has null values in those documents wherever this field's data type is double.

Is there any way to configure DMS/Athena to convert all the integers to doubles?

I see we can write transformation rules(change column type) for the source data in AWS DMS. However that is not yet supported for mongoDB source.


与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…
Welcome To Ask or Share your Answers For Others

1 Reply

0 votes
by (71.8m points)
等待大神答复

与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…
OGeek|极客中国-欢迎来到极客的世界,一个免费开放的程序员编程交流平台!开放,进步,分享!让技术改变生活,让极客改变未来! Welcome to OGeek Q&A Community for programmer and developer-Open, Learning and Share
Click Here to Ask a Question

...