Dolphinscheduler 中的参数及子流程变量池传递失效BUG

1、Dolphinscheduler中的参数

  1. command_param 中的启动参数
  2. 本地参数
  3. 变量池
  4. 全局参数
  5. 项目参数
  6. 内置参数(业务时间参数、系统内置参数、衍生内置参数),衍生内置参数是在Worker端进行处理的

1.1、Master参数设置

org.apache.dolphinscheduler.server.master.runner.TaskExecutionContextFactory#createTaskExecutionContext

public TaskExecutionContext createTaskExecutionContext(TaskInstance taskInstance) throws TaskExecutionContextCreateException {
    ProcessInstance workflowInstance = taskInstance.getProcessInstance();

    ResourceParametersHelper resources =
            Optional.ofNullable(taskPluginManager.getTaskChannel(taskInstance.getTaskType()))
                    .map(taskChannel -> taskChannel.getResources(taskInstance.getTaskParams()))
                    .orElse(null);
    setTaskResourceInfo(resources);

    Map<String, Property> businessParamsMap = new HashMap<>();
    if (workflowInstance != null) {
        businessParamsMap = curingParamsService.preBuildBusinessParams(workflowInstance);
    }

    AbstractParameters baseParam = taskPluginManager.getParameters(ParametersNode.builder()
            .taskType(taskInstance.getTaskType()).taskParams(taskInstance.getTaskParams()).build());

    Map<String, Property> propertyMap = new HashMap<>();
    if (workflowInstance != null) {
        // TODO 主要是这里进行的封装
        propertyMap = curingParamsService.paramParsingPreparation(taskInstance, baseParam, workflowInstance);
    }

    TaskExecutionContext taskExecutionContext = TaskExecutionContextBuilder.get()
            .buildWorkflowInstanceHost(masterConfig.getMasterAddress())
            .buildTaskInstanceRelatedInfo(taskInstance)
            .buildTaskDefinitionRelatedInfo(taskInstance.getTaskDefine())
            // TODO 这里面设置的租户code
            .buildProcessInstanceRelatedInfo(taskInstance.getProcessInstance())
            .buildProcessDefinitionRelatedInfo(taskInstance.getProcessDefine())
            .buildResourceParametersInfo(resources)
            .buildBusinessParamsMap(businessParamsMap)
            // TODO 这里是重点
            .buildParamInfo(propertyMap)
            .create();

    if (taskInstance.getProcessInstance() == null) {
        taskExecutionContext.setTenantCode(taskInstance.getTenantCode());
    }
    
    if (workflowInstance != null) {
        setDataQualityTaskExecutionContext(taskExecutionContext, taskInstance, workflowInstance.getTenantCode());
    }

    setK8sTaskRelatedInfo(taskExecutionContext, taskInstance);
    return taskExecutionContext;
}

org.apache.dolphinscheduler.service.expand.CuringParamsServiceImpl#paramParsingPreparation

org.apache.dolphinscheduler.plugin.task.api.utils.ParameterUtils#convertParameterPlaceholders

评论

暂无评论