close

Filter

loading table of contents...

CoreMedia Content Cloud v11 Upgrade Guide / Version 2110

Table Of Contents

6.9.1 Configuration Changes and Reindexing

The Solr index schema for Content Feeder and CAE Feeder, and the configuration of the Content Feeder was changed to enable the search filter for validation issues by default, and to also support Solr nested documents in the CAE Feeder. See also the updated section Section 4.1.3, “Content Issues” in Search Manual.

Solr Configuration Changes

The Solr index fields _root_ and _nest_path_ were added in the index schema for both Content Feeder and CAE Feeder indexes in content/conf/schema.xml and cae/conf/schema.xml. These files are located in the Blueprint below apps/solr/modules/search/solr-config/src/main/app/configsets.

The fields were optional since version 2104 but not defined by default. Adding them requires recreation of indexes from scratch. If you create new indexes with this version, or if you have already created new indexes with previous versions and these fields defined, then you should add/keep the fields in the schema. For the Content Feeder index, these fields are required if indexing of validation issues is enabled. It's important that you don't change the definition of these fields, if you keep an existing index.

Several deprecated configuration properties have been removed for the Content Feeder, the CAE Feeder, and for applications that connect to Solr for searching.

If you still use any of these properties, you have to replace them with the property that is listed right next to it in the following list (sorted alphabetically):

  • feeder.backgroundFeed.delayfeeder.content.background-feed-delay

  • feeder.executorQueueCapacityfeeder.core.executor-queue-capacity

  • feeder.executorRetryDelayfeeder.core.executor-retry-delay

  • feeder.indexDeletedfeeder.content.index-deleted

  • feeder.indexGroupsfeeder.content.index-groups

  • feeder.indexNameInTextBodyfeeder.content.index-name-in-textbody

  • feeder.indexReferrersfeeder.content.index-referrers

  • feeder.management.passwordfeeder.content.management.password

  • feeder.management.userfeeder.content.management.user

  • feeder.maxBatchBytesfeeder.batch.max-bytes

  • feeder.maxBatchByteSizefeeder.batch.max-bytes

  • feeder.maxBatchSizefeeder.batch.max-size

  • feeder.maxOpenBatchesfeeder.batch.max-open

  • feeder.maxProcessedBatchesfeeder.batch.max-processed

  • feeder.partialUpdate.aspectsfeeder.content.partial-update-aspects

  • feeder.retryConnectToIndexDelay.secondsfeeder.content.retry-connect-to-index-delay

  • feeder.retrySendIdleDelayfeeder.batch.retry-send-idle-delay (see note below)

  • feeder.retrySendMaxDelayfeeder.batch.retry-send-max-delay (see note below)

  • feeder.sendIdleDelayfeeder.batch.send-idle-delay (see note below)

  • feeder.sendMaxDelayfeeder.batch.send-max-delay (see note below)

  • feeder.tika.timeout.millisecondsfeeder.tika.timeout

  • feeder.tika.warn.millisecondsfeeder.tika.warn-time-threshold

  • feeder.updateGroups.background.delayfeeder.content.background-feed-delay

  • feeder.updateGroups.immediatelyfeeder.content.update-groups-immediately

  • solr.collection.caesolr.cae.collection

  • solr.collection.contentsolr.content.collection

  • solr.configSetsolr.cae.config-set (for the CAE Feeder), solr.content.config-set (for the Content Feeder)

  • solr.partialUpdatesfeeder.solr.partial-updates.enabled

  • solr.partialUpdatesSkipIndexCheckfeeder.solr.partial-updates.skip-index-check

Note, that the old properties feeder.sendIdleDelay, feeder.sendMaxDelay, feeder.retrySendIdleDelay, and feeder.retrySendMaxDelay took a value in seconds for the _Content Feeder_, but a value in milliseconds for the _CAE Feeder_. The new properties feeder.batch.send-idle-delay, feeder.batch.send-max-delay, feeder.batch.retry-send-idle-delay, and feeder.batch.retry-send-max-delay take milliseconds for both Content Feeder and CAE Feeder (if the value does not specify a different Spring Boot duration unit like 's').

Solr Terminology Changes

Apache Solr has replaced the names of their replication setup from Master/Slave to Leader/Follower. These names have now been changed in Solr configuration files solrconfig.xml and CoreMedia documentation. For details of the change in Solr, see Solr Upgrade Notes.

The following system properties used to configure Solr replication have been renamed. If you are using the old names in your project, you must update them accordingly:

  • solr.master.urlsolr.leader.url

  • solr.mastersolr.leader

  • solr.slavesolr.follower

Environment variables for the Docker image have also changed. The old environment variables still work, but are deprecated:

  • SOLR_MASTERSOLR_LEADER

  • SOLR_MASTER_URLSOLR_LEADER_URL

  • SOLR_SLAVESOLR_FOLLOWER

  • SOLR_SLAVE_AUTOCREATE_CORESSOLR_FOLLOWER_AUTOCREATE_CORES

  • SOLR_SLAVE_AUTOCREATE_CORES_LISTSOLR_FOLLOWER_AUTOCREATE_CORES_LIST

  • SOLR_SLAVE_AUTOCREATE_THRESHOLDSOLR_FOLLOWER_AUTOCREATE_THRESHOLD

The Maven commands to start and stop a Solr follower node for local development in apps/solr/modules/search/solr-config/pom.xml have also changed to use "follower" instead of "slave". For details, see the comments in that pom.xml file.

In addition to the system properties and environment variables, the following changes have been applied:

  • The default log-location for Solr followers changed: slave-logs/follower-logs/

  • To start a Solr follower locally, you now need to call mvn exec:exec@start-solr-follower (instead of mvn exec:exec@start-solr-slave).

Content Feeder Configuration for Issue Feeding

The configuration of the Content Feeder was changed to index issues, by default. You can disable issue indexing with configuration property feeder.content.issues.index=false, for example if you have decided to not add the fields to the Solr schema to avoid reindexing, or if you are not using the default Solr integration but a custom Indexer that does not support indexing issues as nested documents.

Recreate Index from Scratch for Improved CAE Feeder Database Usage

The CAE Feeder was improved to store data more efficiently in the database, which reduces database disk space requirements and improves throughput. To this end, the data type of some database columns was changed from a string type to a binary type. This change also applies to custom applications based on the Proactive Engine.

When the CAE Feeder is started with an empty database to feed everything from scratch, it will automatically create tables with improved definitions. If started with existing database tables from a previous release, then the CAE Feeder will work as before without improved database usage. Existing database tables are not upgraded. For best performance, it is recommended to start feeding with an empty database.

Search Results

Table Of Contents
warning

Your Internet Explorer is no longer supported.

Please use Mozilla Firefox, Google Chrome, or Microsoft Edge.