Exception while copying data using MLCP

老子叫甜甜 提交于 2019-12-10 20:48:03

问题


I am trying to copy 1 million documents from one database to another database using MLCP but I am getting following Exception.

19/08/30 11:48:08 ERROR contentpump.DatabaseContentReader: RuntimeException reading /integration/test/88398921012548 :java.lang.RuntimeException: Could not buffer value as string

I am not sure about the reason of this exception.

Please guide me to understand the reason.

MLCP with all the options that i used

mlcp copy -mode local -input_host 192.168.1.46 -input_port 9000 -input_username admin -input_password admin -input_database test  -output_host localhost -output_port 8000 -output_username admin -output_password admin -output_database test

回答1:


MLCP tends to run multiple threads in parallel, but that could cause source or target system to run out of resources. Also, you are running MLCP on the same host as the target database, they might compete for resources as well. It is probably best to see what happens if you pace down MLCP using -thread_count 1. From there you can scale up again.

Also keep an eye on MLCP memory consumption, you might need to give it more memory using JVM_OPTS. See also: https://stackoverflow.com/a/54685758/918496

HTH!



来源:https://stackoverflow.com/questions/57721535/exception-while-copying-data-using-mlcp

标签
易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!