Dolphinscheduler 中的参数及子流程变量池传递失效BUG
文章目录
1、Dolphinscheduler中的参数
- command_param 中的启动参数
- 本地参数
- 变量池
- 全局参数
- 项目参数
- 内置参数(业务时间参数、系统内置参数、衍生内置参数),衍生内置参数是在Worker端进行处理的
1.1、Master参数设置
org.apache.dolphinscheduler.server.master.runner.TaskExecutionContextFactory#createTaskExecutionContext
public TaskExecutionContext createTaskExecutionContext(TaskInstance taskInstance) throws TaskExecutionContextCreateException {
ProcessInstance workflowInstance = taskInstance.getProcessInstance();
ResourceParametersHelper resources =
Optional.ofNullable(taskPluginManager.getTaskChannel(taskInstance.getTaskType()))
.map(taskChannel -> taskChannel.getResources(taskInstance.getTaskParams()))
.orElse(null);
setTaskResourceInfo(resources);
Map<String, Property> businessParamsMap = new HashMap<>();
if (workflowInstance != null) {
businessParamsMap = curingParamsService.preBuildBusinessParams(workflowInstance);
}
AbstractParameters baseParam = taskPluginManager.getParameters(ParametersNode.builder()
.taskType(taskInstance.getTaskType()).taskParams(taskInstance.getTaskParams()).build());
Map<String, Property> propertyMap = new HashMap<>();
if (workflowInstance != null) {
// TODO 主要是这里进行的封装
propertyMap = curingParamsService.paramParsingPreparation(taskInstance, baseParam, workflowInstance);
}
TaskExecutionContext taskExecutionContext = TaskExecutionContextBuilder.get()
.buildWorkflowInstanceHost(masterConfig.getMasterAddress())
.buildTaskInstanceRelatedInfo(taskInstance)
.buildTaskDefinitionRelatedInfo(taskInstance.getTaskDefine())
// TODO 这里面设置的租户code
.buildProcessInstanceRelatedInfo(taskInstance.getProcessInstance())
.buildProcessDefinitionRelatedInfo(taskInstance.getProcessDefine())
.buildResourceParametersInfo(resources)
.buildBusinessParamsMap(businessParamsMap)
// TODO 这里是重点
.buildParamInfo(propertyMap)
.create();
if (taskInstance.getProcessInstance() == null) {
taskExecutionContext.setTenantCode(taskInstance.getTenantCode());
}
if (workflowInstance != null) {
setDataQualityTaskExecutionContext(taskExecutionContext, taskInstance, workflowInstance.getTenantCode());
}
setK8sTaskRelatedInfo(taskExecutionContext, taskInstance);
return taskExecutionContext;
}org.apache.dolphinscheduler.service.expand.CuringParamsServiceImpl#paramParsingPreparation
org.apache.dolphinscheduler.plugin.task.api.utils.ParameterUtils#convertParameterPlaceholders
评论
登录后参与技术讨论,分享你的经验与见解。
登录 / 注册暂无评论