The value type used for most entries of robots

Policy type for robots.txt policies

Robots.txt input type

Create a robots.txt policy entry

policy
    { userAgent = SingleValue "*"
    , allow = Just (SingleValue "*")
    , disallow = Nothing
    }

Creates a String with the robots.txt output

robots
    { sitemap = SingleValue "/sitemap.xml"
    , host = "https://marcodaniels.com"
    , policies =
        [ policy
            { userAgent = SingleValue "*"
            , allow = Just (SingleValue "*")
            , disallow = Nothing
            }
        ]
    }

Add crawl-delay property to the policy entry

policy
    { userAgent = SingleValue "*"
    , allow = Just (SingleValue "*")
    , disallow = Nothing
    }
    |> withCrawlDelay 10

Clean-param type for withCleanParam

Add clean param property to the policy entry

policy
    { userAgent = SingleValue "*"
    , allow = Just (SingleValue "*")
    , disallow = Nothing
    }
    |> withCleanParam [ { param = "id", path = "/user" } ]