batch spring 重复执行_Spring Batch

Spring Batch_JOB重启机制

在这一篇文章对于restart做了试验，http://my.oschina.net/xinxingegeya/blog/344817在这片文章里，我们只是当job成功时，重启了job，对于job失败后，重启job有什么效果，我没有演示，下面我们就来演示一下当job失败退出后，再重启job有什么效果。

先做一个导致job失败的情景，如下的processor ：

ThrowExceptionProcessor.java

package com.lyx.batch;

import org.springframework.batch.item.ItemProcessor;

public class ThrowExceptionProcessor implements

ItemProcessor {

public PeopleDESC process(People item) throws Exception {

System.out.println("process people desc");

if ("lyx".equals(item.getFirstName())) {

throw new InvalidDataException("invalid data");

}

return new PeopleDESC(item.getLastName(), item.getFirstName(), Thread

.currentThread().getName());

}

当判断某条数据符合失败条件后，抛出异常，导致job失败。

下面是整个配置文件：spring-batch-failure-restart.xml

xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:batch="http://www.springframework.org/schema/batch"

xmlns:context="http://www.springframework.org/schema/context"

xsi:schemaLocation="http://www.springframework.org/schema/beans http://www.springframework.org/schema/beans/spring-beans-4.0.xsd

http://www.springframework.org/schema/batch http://www.springframework.org/schema/batch/spring-batch.xsd

http://www.springframework.org/schema/context http://www.springframework.org/schema/context/spring-context.xsd">

class="org.springframework.batch.item.database.JdbcCursorItemReader">

start-limit="3">

writer="addDescPeopleWriter" commit-interval="2" />

scope="step">

first_name like ? or last_name like ?]]>

destroy-method="close">

data-source="dataSource" transaction-manager="transactionManager"

isolation-level-for-create="REPEATABLE_READ" table-prefix="BATCH_"

max-varchar-length="1000" />

class="org.springframework.jdbc.datasource.DataSourceTransactionManager">

class="org.springframework.batch.core.launch.support.SimpleJobLauncher">

运行任务：

AppMain13.java

package com.lyx.batch;

import org.springframework.batch.core.ExitStatus;

import org.springframework.batch.core.Job;

import org.springframework.batch.core.JobExecution;

import org.springframework.batch.core.JobParametersBuilder;

import org.springframework.batch.core.JobParametersInvalidException;

import org.springframework.batch.core.launch.JobLauncher;

import org.springframework.batch.core.repository.JobExecutionAlreadyRunningException;

import org.springframework.batch.core.repository.JobInstanceAlreadyCompleteException;

import org.springframework.batch.core.repository.JobRestartException;

import org.springframework.context.ApplicationContext;

import org.springframework.context.support.ClassPathXmlApplicationContext;

/**

* 测试当任务失败时，重启任务

* @author Lenovo

public class AppMain13 {

public static void main(String[] args)

throws JobExecutionAlreadyRunningException, JobRestartException,

JobInstanceAlreadyCompleteException, JobParametersInvalidException {

long startTime = System.currentTimeMillis(); // 获取开始时间

@SuppressWarnings("resource")

ApplicationContext context = new ClassPathXmlApplicationContext(

new String[] { "classpath:spring-batch-failure-restart.xml" });

JobParametersBuilder jobParametersBuilder = new JobParametersBuilder();

Job job = (Job) context.getBean("addPeopleDescJob");

JobLauncher launcher = (JobLauncher) context.getBean("jobLauncher");

JobExecution result = launcher.run(job,

jobParametersBuilder.toJobParameters());

ExitStatus es = result.getExitStatus();

if (es.getExitCode().equals(ExitStatus.COMPLETED.getExitCode())) {

System.out.println("任务正常完成");

} else {

System.out.println("任务失败，exitCode=" + es.getExitCode());

}

long endTime = System.currentTimeMillis(); // 获取结束时间

System.out.println("程序运行时间： " + (endTime - startTime) + "ms");

}

第一次运行的结果：

严重: Encountered an error executing step addDescStep in job addPeopleDescJob

com.lyx.batch.InvalidDataException: invalid data

at com.lyx.batch.ThrowExceptionProcessor.process(ThrowExceptionProcessor.java:11)

十一月 19, 2014 4:56:16 下午 org.springframework.batch.core.launch.support.SimpleJobLauncher run

信息: Job: [FlowJob: [name=addPeopleDescJob]] completed with the following parameters: [{}] and the following status: [FAILED]

任务失败，exitCode=FAILED

程序运行时间： 7028ms

如上，显示job失败，那么失败的job 在spring batch 的meta table里存储了什么信息：

mysql> select * from batch_step_execution \G

*************************** 1. row ***************************

STEP_EXECUTION_ID: 1

VERSION: 52

STEP_NAME: addDescStep

JOB_EXECUTION_ID: 1

START_TIME: 2014-11-19 16:56:11

END_TIME: 2014-11-19 16:56:16

STATUS: FAILED

COMMIT_COUNT: 50

READ_COUNT: 102

FILTER_COUNT: 0

WRITE_COUNT: 100

READ_SKIP_COUNT: 0

WRITE_SKIP_COUNT: 0

PROCESS_SKIP_COUNT: 0

ROLLBACK_COUNT: 1

EXIT_CODE: FAILED

EXIT_MESSAGE: com.lyx.batch.InvalidDataException: invalid data

at com.lyx.batch.ThrowExceptionProcessor.process(ThrowExceptionProcessor.java:11)

at com.lyx.batch.ThrowExceptionProcessor.process(ThrowExceptionProcessor.java:1)

at org.springframework.batch.core.step.item.SimpleChunkProcessor.doProcess(SimpleChunkProcessor.java:126)

at org.springframework.batch.core.step.item.SimpleChunkProcessor.transform(SimpleChunkProcessor.java:293)

at org.springframework.batch.core.step.item.SimpleChunkProcessor.process(SimpleChunkProcessor.java:192)

at org.springframework.batch.core.step.item.ChunkOrientedTasklet.execute(ChunkOrientedTasklet.java:75)

at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:406)

at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:330)

at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:133)

at o

LAST_UPDATED: 2014-11-19 16:56:16

1 row in set (0.00 sec)

mysql>

这就是step 的运行信息，请注意几个关键的数据，就是

COMMIT_COUNT: 50

READ_COUNT: 102

FILTER_COUNT: 0

WRITE_COUNT: 100

READ_SKIP_COUNT: 0

WRITE_SKIP_COUNT: 0

PROCESS_SKIP_COUNT: 0

ROLLBACK_COUNT: 1

好了，我们先做这些工作，先不去修正会导致异常抛出的数据，我们第二次运行这个job

第二次运行的结果：

信息: Executing step: [addDescStep]

process people desc

十一月 19, 2014 5:03:30 下午 org.springframework.batch.core.step.AbstractStep execute

严重: Encountered an error executing step addDescStep in job addPeopleDescJob

com.lyx.batch.InvalidDataException: invalid data

任务失败，exitCode=FAILED

程序运行时间： 3233ms

十一月 19, 2014 5:03:30 下午 org.springframework.batch.core.launch.support.SimpleJobLauncher run

信息: Job: [FlowJob: [name=addPeopleDescJob]] completed with the following parameters: [{}] and the following status: [FAILED]

如上所示，任务失败，再来看一下失败的任务在 spring batch meta table 里存储了什么信息：

mysql> select * from batch_step_execution where step_execution_id = 2 \G

*************************** 1. row ***************************

STEP_EXECUTION_ID: 2

VERSION: 2

STEP_NAME: addDescStep

JOB_EXECUTION_ID: 2

START_TIME: 2014-11-19 17:03:30

END_TIME: 2014-11-19 17:03:30

STATUS: FAILED

COMMIT_COUNT: 0

READ_COUNT: 2

FILTER_COUNT: 0

WRITE_COUNT: 0