Drupal 11: Batch Processing Using Drush

Doing this changes the form submission handler that runs the batch running code to the following.Whilst there is nothing wrong with running the Batch API with everything in a form class, it is normally better to abstract the batch processing code into a separate class.We could even take this a step further by having a central place where the batch operations are set up, like a service for example, and then just call this service from the form and Drush command. This means we don’t need to copy and paste any code when we want to kick off the batch processing.To set up a Drush command we need to create a drush.services.yml file in the root of the module. This file looks very much like the normal module *.services.yml file that we use to create custom services in Drupal 8+.Now that we have the batch class in place we can rework the form submission handler to use this class. This is just a case of changing the setFinishCallback() and addOperation() methods to point at the new class.

The Batch Class

services:
batch_class_example.commands:
class: Drupalbatch_class_exampleCommandsBatchCommands
tags:
- { name: drush.command }
arguments: ['@logger.factory']

Using a separate batch class to contain the process and finish methods is a much better way of setting things up as it allows you to abstract away the batch process from the action that starts it. This means that you can start the batch from anywhere, even a Drush command.$ drush batch_class_example:run
> [notice] Processing batch #0 batch size 100 for total 1,000 items.
> [notice] Processing batch #1 batch size 100 for total 1,000 items.
> [notice] Processing batch #2 batch size 100 for total 1,000 items.
> [notice] Processing batch #3 batch size 100 for total 1,000 items.
> [notice] Processing batch #4 batch size 100 for total 1,000 items.
> [notice] Processing batch #5 batch size 100 for total 1,000 items.
> [notice] Processing batch #6 batch size 100 for total 1,000 items.
> [notice] Processing batch #7 batch size 100 for total 1,000 items.
> [notice] Processing batch #8 batch size 100 for total 1,000 items.
> [notice] Processing batch #9 batch size 100 for total 1,000 items.
> [notice] Message: Class batch completed processed 1000, skipped 272, updated 504, failed 224 in
> 0 sec.
>
[notice] Batch operations end.

Batch operation in Drupal are useful in their own right, but by abstracting their processing and finish methods away from where they are setup we can run the batch operations from wherever we need to. Doing this gives users of the system the ability to automate tasks on the command line so that a user doesn’t need to sit and wait for the batch processing page to complete.The following shows the basic structure of this class.We can now run the batch operation in Drush, which will print out the following messages.

Running The Batch From Drush

Here is the BatchCommands class in full.Now that we have separated the batch running code into a separate class we can run the same code from a Drush command.<?php

}

If you want to experiment and use this code in your own projects then you can find all of the source code for this module on GitHub. The source code is a sub module of a in a module that contains all of the source code for all of the articles in this series about the Drupal Batch API.The following code is added to the drush.services.yml file and will setup a Drush class that will inject commands into the Drush namespace. We also inject the logger.factory service so that we can log information in the command.This is the second part of a series of articles looking at the Batch API in Drupal. The Batch API is a system in Drupal that allows data to be processed in small chunks in order to prevent timeout errors or memory problems.In the next article in this series we will be looking at the finish state of the batch processor methods that gives us the ability to run the batch process for as long as we need. This is different to what I have currently shown where we setup the initial conditions of the batch run and let it execute to completion.Allowing you batch processes to be run via Drush is a really powerful feature for a module to include. It means that any big process that can be run by a user can be run automatically via a Drush command.In the previous article we looked at how to setup the batch process using a form, with the batch methods being contained within the structure of the form class. When the form was submitted the batch process ran through 1,000 items and then printed out a result at the end./**
* Run a batch operation via a Drush command.
*
* @command batch_class_example:run
*
* @validate-module-enabled batch_class_example
*
* @usage batch_class_example:run
*/
public function runBatchclassExample() {
}

This is normally how I set things up when using the Batch API.To setup and run the batch we just need to copy the batch setup code from the form class. We are essentially running setting up the batch in the same way and the batch will be executed in a similar manner. The key difference when setting up the batch in Drush is that we also add a call to drush_backend_batch_process() function. This is an internal Drush function that will progressively process the batch to completion, instead of processing the batch via progressive page loads.To create a batch class I normally create a directory called “Batch” inside the module “/src” directory that contains any batch class I need to define. The contents of the class are the two batch methods from the form class used previously, namely the batchProcess() and batchFinished() methods.public function submitForm(array &$form, FormStateInterface $form_state): void {
$batch = new BatchBuilder();
$batch->setTitle('Running batch process.')
->setFinishCallback([BatchClass::class, 'batchFinished'])
->setInitMessage('Commencing')
->setProgressMessage('Processing...')
->setErrorMessage('An error occurred during processing.');

$form_state->setRedirectUrl(new Url($this->getFormId()));
}

<?php

}

I haven’t changed the internal code of these two methods at all and so I have not reproduced them here. If you want to grab the code then you can either look at the previous Batch API article, or have a look at the full class on GitHub. All of the source code for this Batch API example and the other Batch API articles in this series are available on GitHub.