Skip to main content

Register a Software Component in Catalog

Create an IDP YAML

The IDP YAML is a crucial descriptor file that provides metadata about the software components you register within our IDP. It serves as a blueprint, detailing essential information about each component, such as its name, description, owner, and other related metadata. This file ensures that our portal accurately represents and organizes the software components, making it easier for teams to discover and understand the tools and services available.

Although it's possible to name catalog entity descriptor files however you wish, we recommend that you name them idp.yaml.

info

idp.yaml follows the same Descriptor Format of Catalog Entities as Backstage.io.

Start with basic entity information

Begin your YAML file with the basic entity information, this contains the kind which could be any of the following:

  1. Component
  2. Template
  3. API
  4. Resource
  5. Location

and few others.

Out of this Component is quite widely used for service, website, library, etc.. which needs to be specified as spec.type as discussed below.

apiVersion: backstage.io/v1alpha1
kind: Component

Provide metadata

Under the metadata section, provide essential details about your component:

metadata:
name: artist-service
description: The place to be, for great artists

Add labels (Optional)

You can add key/value pairs as labels to classify the component:

labels:
example.com/custom: custom_label_value

Add annotations (Optional)

Annotations are used to reference external systems or provide additional non-identifying metadata:

annotations:
harness.io/project-url: "https://app.harness.io/ng/account/accountid/cd/orgs/orgid/projects/projectid"
github.com/project-slug: github/example-org/artist-website

Include tags (Optional)

Tags are single-valued strings used to classify entities:

tags:
- java

Add Relations

For the relationship graph to get populated, you need to add the dependencies in the catalog-info.yaml

The field spec.owner is a reference. In this case, the string group:pet-managers was given by the user. That means that the kind is Group, the namespace is left out, and the name is pet-managers.

The entries in providesApis are references. In this case, none of them needs to specify a kind since we know from the context that that's the only kind that's supported here. The second entry specifies a namespace but the other ones don't, and in this context, the default is to refer to the same namespace as the originating entity (external-systems here). So the three references essentially expand to api:external-systems/petstore, api:internal/streetlights, and api:external-systems/hello-world. We expect there to exist three API kind entities in the catalog matching those references.

Read More about relations, in the system model docs. Also reference once mentioned for a single component catalog-info.yaml doesn't need to be included in the dependant components catalog-info.yaml to show up in the relationship graph of both the entities.

# Example catalog-info.yaml
...
spec:
type: service
lifecycle: experimental
owner: group:pet-managers
dependsOn:
- Component:manager
- Component:ng-manager
- Component:platform-service
providesApis:
- accesscontrol-service
- petstore
- internal/streetlights
- hello-world
...

External hyperlinks related to the entity can be added for contextual information:

Allow External URLs

If you're referencing external URLs in your IDP.yaml file, such as Swagger documentation links, please ensure that these URLs are allowed within the Harness Internal Developer Portal. This is a crucial step to ensure that the portal can access and display content from these external sources.

To allow external URLs:

  • Navigate to Admin in the Harness Internal Developer Portal.
  • Go to URL Allow List.
  • Click on +Add Host.
  • In the provided field, enter the URL pattern you wish to allow. For example, to allow all URLs from Swagger, you'd enter *.swagger.com.
  • Confirm and save your changes.

By following the above steps, you ensure that the portal can safely and correctly access the external content referenced in your IDP.yaml file.

links:
- url: https://admin.example-org.com
title: Admin Dashboard
type: admin-dashboard

Specify component details

Under the spec section, provide specific details about the component:

Spec type

The current set of well-known and common values for this field is:

  1. service - a backend service, typically exposing an API
  2. website - a website
  3. library - a software library, such as an npm module or a Java library

Spec owner

In the Harness Internal Developer Portal, the owner of a component is identified by the Harness User Group ID. This User Group ID represents the collective entity that holds ultimate responsibility for the component and possesses the authority and capability to develop and maintain it. Should any issues arise or if there are requests for features, this User Group will serve as the primary point of contact. The primary purpose of this field in the Harness IDP is for display, ensuring that individuals accessing catalog items can easily identify the responsible User Group for a given component.

How to get the Harness User Group ID
  • Navigate to the bottom left of the Harness dashboard and select Account settings.
  • From the Account settings menu, select Access Control.
  • Once in the Access Control section, look to the top right of the page and click on User Groups.
  • You'll see a search bar at the top. Use this to search for the specific user group you're interested in.
  • Once you've located the desired user group, you'll find the User Group ID listed. Simply copy this ID for your reference.

Spec system

A system is a collection of resources and components. The system may expose or consume one or several APIs. It is viewed as abstraction level that provides potential consumers insights into exposed features without needing a too detailed view into the details of all components. This also gives the owning team the possibility to decide about published artifacts and APIs.

Descriptor files for this kind may look as follows.

apiVersion: backstage.io/v1alpha1
kind: System
metadata:
name: Custom Dashboards
description: Handles creation of Custom Dashboard across different Harness Modules
spec:
owner: platformengineeringteam

Spec lifecycle

The lifecycle state of the component, e.g. production. This field is required.

The software catalog accepts any lifecycle value, but an organization should take great care to establish a proper taxonomy for these.

The current set of well-known and common values for this field is:

  1. production - an established, owned, maintained component
  2. deprecated - a component that is at the end of its lifecycle, and may disappear at a later point in time

Example Yaml with all the Spec

spec:
type: service
owner: platformengineeringteam
system: developer-experience
lifecycle: production

Substitutions in the descriptor format:

The descriptor format supports substitutions using $text, $json, and $yaml. Placeholders like $json: https://example.com/entity.json are substituted by the content of the referenced file. You can reference relative files like ./referenced.yaml from the same location. For example:

spec:
type: service
owner: platformengineeringteam
system: developer-experience
lifecycle: production
definition: $text://developer.harness.io/docs/enhancing-developer-experience

Save the file:

Save the file with the recommended name idp.yaml and upload it on your file in your Git repository. If it is a mono-repo, navigate to its directory and create a idp.yaml at the root of the directory. The file can technically live anywhere (for example, .harness/idp.yaml).

Following is an example of the same.

apiVersion: backstage.io/v1alpha1
kind: Component
metadata:
name: my-new-service
description: Description of my new service
annotations:
pagerduty.com/integration-key: <sample-service-integration-key>
tags:
- java
links:
- url: https://admin.example-org.com
title: Admin Dashboard
type: admin-dashboard
spec:
type: service
lifecycle: production
owner: team-a
system: project-x

Register with Harness IDP:

To register this component with Harness IDP, you'll need to submit this YAML file to the appropriate API endpoint or Register the existing component using UI.

Follow the steps below to register components in the Harness Platform UI:

  1. Once the file is created in your git repo, copy the full URL to the file. For example, https://github.com/harness-community/idp-samples/blob/main/catalog-info.yaml.

  1. In the left navigation, select Create, and then select Register Software Component.

  1. Enter the URL to your new idp.yaml.

  1. Click Import.

The new component is available in your catalog.

Further Reading

For those looking to expand their knowledge and explore more advanced methods of registering software components on Harness IDP, consider the following:

GitHub Auto-Discovery Plugin

If you're aiming to register multiple components in the software catalog concurrently, the GitHub auto-discovery plugin is a valuable tool. This plugin automates the discovery and registration of components, with all the idp yamls located in single repo.

Using the Catalog API

Another effective approach is leveraging the catalog API. By running a custom script as shown in the example below, you can automate the registration of components, providing a more programmatic method for bulk registrations.

#!/bin/bash

set -e

function usage {
echo "usage: $0 [-a accountIdentifier] [-x xApiKey] [-u bearerAuthorization] [-l catalogLocations]"
echo " -a Harness Account Identifier"
echo " -x Harness X-API-KEY for the given account"
echo " -u Harness Bearer Authorization from the logged in session"
echo " -l Catalog locations to be registered in Harness IDP. Comma seperated list of locations"
exit 1
}

while getopts a:x:u:l:h flag
do
case "${flag}" in
a) ACCOUNT_IDENTIFIER=${OPTARG};;
x) X_API_KEY=${OPTARG};;
u) BEARER_AUTHORIZATION=${OPTARG};;
l) CATALOG_LOCATIONS=${OPTARG};;
h | ?) usage
esac
done

echo -e "\nStarting catalog location registration for given location in Harness IDP...";

CATALOG_LOCATION_REGISTER_DATA='{"type":"url","target":"CATALOG_LOCATION_TARGET"}'

for LOCATION in ${CATALOG_LOCATIONS//,/ }
do
echo -e "\n--------"
echo "Registering $LOCATION catalog location in Harness IDP account $ACCOUNT_IDENTIFIER"

POST_DATA=${CATALOG_LOCATION_REGISTER_DATA/CATALOG_LOCATION_TARGET/$LOCATION}

RESULT_HTTP_CODE=$(curl --write-out %{http_code} -s --output /dev/null -H "Content-Type: application/json" -H "Harness-Account: ${ACCOUNT_IDENTIFIER}" -H "x-api-key: ${X_API_KEY}" -H "Authorization: Bearer ${BEARER_AUTHORIZATION}" -X POST --data "${POST_DATA}" "https://idp.harness.io/${ACCOUNT_IDENTIFIER}/idp/api/catalog/locations")

if [[ "$RESULT_HTTP_CODE" -ne 201 ]] ; then
echo "Failed registering $LOCATION catalog location in Harness IDP account $ACCOUNT_IDENTIFIER"
else
echo "Successfully registerd $LOCATION catalog location in Harness IDP account $ACCOUNT_IDENTIFIER"
fi

echo "--------"
done

echo -e "\nCompleted catalog location registration for given location in Harness IDP...";