/usr/bin/jq: Argument list too long error bash

问题

I want to replace the value in sample json from larger swagger.json file content and it is too large.

Error:
/usr/bin/jq: Argument list too long error bash

worked to solve this issue for a few days and cannot identify the issue here. this is the sample json file:

{
   "name": "",
   "description": "",
   "context": "",
   "version": "",
   "provider": "cbs",
   "apiDefinition": "",
   "wsdlUri": null,
   "responseCaching": "Disabled",
   "cacheTimeout": 300,
   "destinationStatsEnabled": false,
   "isDefaultVersion": true,
   "transport":    [
      "http",
      "https"
   ],
   "tags": ["PROVIDER_","MIFE"],
   "tiers": ["Unlimited","Default","Silver","Subscription","Gold","Premium","Bronze"],
   "maxTps":    {
      "sandbox": 5000,
      "production": 1000
   },
   "visibility": "PUBLIC",
   "visibleRoles": [],
   "endpointConfig": "",
   "endpointSecurity":    {
      "username": "user",
      "type": "basic",
      "password": "pass"
   },
   "gatewayEnvironments": "Production and Sandbox",
   "sequences": [],
   "subscriptionAvailability": null,
   "subscriptionAvailableTenants": [],
   "businessInformation":    {
      "businessOwnerEmail": "BUSINESSOWNEREMAIL_",
      "technicalOwnerEmail": "TECHNICALOWNEREMAIL_",
      "technicalOwner": "TECHNICALOWNER_",
      "businessOwner": "BUSINESSOWNER_"
   },
   "corsConfiguration":    {
      "accessControlAllowOrigins": ["*"],
      "accessControlAllowHeaders":       [
         "authorization",
         "Access-Control-Allow-Origin",
         "Content-Type",
         "SOAPAction"
      ],
      "accessControlAllowMethods":       [
         "GET",
         "PUT",
         "POST",
         "DELETE",
         "PATCH",
         "OPTIONS"
      ],
      "accessControlAllowCredentials": false,
      "corsConfigurationEnabled": false
   }
}

swagger.json file - Click here to download swagger.json file

this is the command i using and it give me a error which i as arguments too large.

swagger = $(cat swagger.json)

jq -r --arg swagger "$swagger" '.apiDefinition = $swagger' <<<"$json"

Can anyone please help!

swagger = $(cat swagger.json)

回答1:

The Q does not explicitly say how $swagger has been set, but it would seem that rather than using --arg swagger $swagger you would be better off using one of the file-oriented command-line options, perhaps along the lines of:

--argfile swagger swagger.json

There are many alternatives, but to explore these sensibly here, it would be best if you provided at least one complete but very TINY example. (The example does NOT have to illustrate the "Argument list too long" error!)

Caveat

If you are worried that the --argfile option is deprecated, then by all means use --slurpfile instead if your jq has it, but note that the latter option wraps the file contents into a JSON array, so you would have to take that into account.

These and other options are all presented succinctly in the official documentation at https://stedolan.github.io/jq/manual/

回答2:

From your example:

jq -r --arg swagger "$swagger" '.apiDefinition = $swagger' <<<"$json"

I'm assuming you want the output to result in a JSON object with a key "apiDefinition", and its value being set to the content of swagger.json (which contains valid JSON).

In that case this works:

jq -n --slurpfile swagger swagger.json '{"apiDefintion": $swagger[0]}'

The first 10 lines of the resulting output:

{
  "apiDefintion": [
    {
      "id": 1,
      "first_name": "Samson",
      "last_name": "Wandrack",
      "email": "swandrack0@hibu.com",
      "gender": "Male",
      "ip_address": "122.171.218.251"
    },

-n is required in this case, to use the JSON on the command line as the input JSON, rather than reading it from stdin or a file.
--slurpfile puts the contents of swagger.json into the variable $swagger, as an array.
-r is not needed, as it has no effect unless the output is just strings (and it's raw output makes it invalid JSON).
$swagger[0] is used to only include the first item of the slurped array.

From the documentation at https://stedolan.github.io/jq/manual/:

--null-input/-n:

Don't read any input at all! Instead, the filter is run once using null as the input. This is useful when using jq as a simple calculator or to construct JSON data from scratch.

--slurpfile variable-name filename:

This option reads all the JSON texts in the named file and binds an array of the parsed JSON values to the given global variable. If you run jq with --slurpfile foo bar, then $foo is available in the program and has an array whose elements correspond to the texts in the file named bar.

--raw-output / -r:

With this option, if the filter's result is a string then it will be written directly to standard output rather than being formatted as a JSON string with quotes. This can be useful for making jq filters talk to non-JSON-based systems.

来源：https://stackoverflow.com/questions/59854249/usr-bin-jq-argument-list-too-long-error-bash

标签

bash