• Failed to rollback to checkpoint/savepoint hdfs://mycluster:8020/ck/sapgateway


    Failed to rollback to checkpoint/savepoint hdfs://mycluster:8020/ck/sapgateway

    job failed during initialization of JobManager
    org.apache.flink.runtime.client.JobInitializationException: Could not start the JobMaster.
    	at org.apache.flink.runtime.jobmaster.DefaultJobMasterServiceProcess.lambda$new$0(DefaultJobMasterServiceProcess.java:97)
    	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
    	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
    	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
    	at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1609)
    	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
    	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
    	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    	at java.lang.Thread.run(Thread.java:750)
    Caused by: java.util.concurrent.CompletionException: java.lang.IllegalStateException: Failed to rollback to checkpoint/savepoint hdfs://mycluster:8020/ck/sapgateway2/006ef2cdfa3fe9d1407fb857d531a5fb/chk-204. Cannot map checkpoint/savepoint state for operator 84bd33e4b1570c4e7e6286558b60a153 to the new program, because the operator is not available in the new program. If you want to allow to skip this, you can set the --allowNonRestoredState option on the CLI.
    	at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273)
    	at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:280)
    	at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1606)
    	... 7 more
    Caused by: java.lang.IllegalStateException: Failed to rollback to checkpoint/savepoint hdfs://mycluster:8020/ck/sapgateway2/006ef2cdfa3fe9d1407fb857d531a5fb/chk-204. Cannot map checkpoint/savepoint state for operator 84bd33e4b1570c4e7e6286558b60a153 to the new program, because the operator is not available in the new program. If you want to allow to skip this, you can set the --allowNonRestoredState option on the CLI.
    	at org.apache.flink.runtime.checkpoint.Checkpoints.throwNonRestoredStateException(Checkpoints.java:230)
    	at org.apache.flink.runtime.checkpoint.Checkpoints.loadAndValidateCheckpoint(Checkpoints.java:194)
    	at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.restoreSavepoint(CheckpointCoordinator.java:1629)
    	at org.apache.flink.runtime.scheduler.DefaultExecutionGraphFactory.tryRestoreExecutionGraphFromSavepoint(DefaultExecutionGraphFactory.java:163)
    	at org.apache.flink.runtime.scheduler.DefaultExecutionGraphFactory.createAndRestoreExecutionGraph(DefaultExecutionGraphFactory.java:138)
    	at org.apache.flink.runtime.scheduler.SchedulerBase.createAndRestoreExecutionGraph(SchedulerBase.java:342)
    	at org.apache.flink.runtime.scheduler.SchedulerBase.<init>(SchedulerBase.java:190)
    	at org.apache.flink.runtime.scheduler.DefaultScheduler.<init>(DefaultScheduler.java:122)
    	at org.apache.flink.runtime.scheduler.DefaultSchedulerFactory.createInstance(DefaultSchedulerFactory.java:132)
    	at org.apache.flink.runtime.jobmaster.DefaultSlotPoolServiceSchedulerFactory.createScheduler(DefaultSlotPoolServiceSchedulerFactory.java:110)
    	at org.apache.flink.runtime.jobmaster.JobMaster.createScheduler(JobMaster.java:340)
    	at org.apache.flink.runtime.jobmaster.JobMaster.<init>(JobMaster.java:317)
    	at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.internalCreateJobMasterService(DefaultJobMasterServiceFactory.java:107)
    	at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.lambda$createJobMasterService$0(DefaultJobMasterServiceFactory.java:95)
    	at org.apache.flink.util.function.FunctionUtils.lambda$uncheckedSupplier$4(FunctionUtils.java:112)
    	at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
    	... 7 more
    
    • 1
    • 2
    • 3
    • 4
    • 5
    • 6
    • 7
    • 8
    • 9
    • 10
    • 11
    • 12
    • 13
    • 14
    • 15
    • 16
    • 17
    • 18
    • 19
    • 20
    • 21
    • 22
    • 23
    • 24
    • 25
    • 26
    • 27
    • 28
    • 29
    • 30
    • 31
    • 32
    • 33
    • 34
    • 35
    • 36
    • 37

    解決方法:需要加上-n參數

    bin/flink run -d -t yarn-per-job -s hdfs://mycluster:8020/ck/sapgateway2/006ef2cdfa3fe9d1407fb857d531a5fb/chk-204  -n -c flink.FlinkCDC /home/sarah/FlinkcdcAPI-1.0-SNAPSHOT.jar
    
    • 1
  • 相关阅读:
    攻防世界---misc---心仪的公司
    SDL_Image STB_Image 中文路径
    linux Ubuntu 22.04工作区workspace介绍
    Redis原理(一):Redis数据结构(上)
    【HMS core】【FAQ】典型问题合集7
    MATLAB Simulink和S7-1200PLC MOBUSTCP通信
    Java反射API详解与应用场景
    提升后端API性能的几种解决方案
    第一节:Git 安装配置及常用命令
    函数题42 习题11-2 查找星期《C语言程序设计(第4版)》题目集
  • 原文地址:https://blog.csdn.net/m0_37759590/article/details/132619369