How to grep for unicode � in a bash script

The name of the pictureThe name of the pictureThe name of the pictureClash Royale CLAN TAG#URR8PPP











up vote
2
down vote

favorite












if grep -q "�" out.txt
 then
 echo "working"
 else
 cat out.txt
fi


Basically, if the file "out.txt" contains "�" anywhere in the file I would like it to echo "working" AND if the file "out.txt" does NOT contain "�" anywhere in the file then I would like it to cat out.txt






linux bash grep scripting







share|improve this question







New contributor




Stuart Sloan is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.



















  • It looks correct, it should work (btw, I have no font for your unicode character to see, but none of them has any special meaning). grep long understands unicode (which makes it much slower, so to search for ascii strings, a LANG=C grep is a huge performance improvement).
    – peterh
    22 mins ago















up vote
2
down vote

favorite












if grep -q "�" out.txt
 then
 echo "working"
 else
 cat out.txt
fi


Basically, if the file "out.txt" contains "�" anywhere in the file I would like it to echo "working" AND if the file "out.txt" does NOT contain "�" anywhere in the file then I would like it to cat out.txt






linux bash grep scripting







share|improve this question







New contributor




Stuart Sloan is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.



















  • It looks correct, it should work (btw, I have no font for your unicode character to see, but none of them has any special meaning). grep long understands unicode (which makes it much slower, so to search for ascii strings, a LANG=C grep is a huge performance improvement).
    – peterh
    22 mins ago













up vote
2
down vote

favorite









up vote
2
down vote

favorite











if grep -q "�" out.txt
 then
 echo "working"
 else
 cat out.txt
fi


Basically, if the file "out.txt" contains "�" anywhere in the file I would like it to echo "working" AND if the file "out.txt" does NOT contain "�" anywhere in the file then I would like it to cat out.txt






linux bash grep scripting







share|improve this question







New contributor




Stuart Sloan is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct. 











if grep -q "�" out.txt
 then
 echo "working"
 else
 cat out.txt
fi


Basically, if the file "out.txt" contains "�" anywhere in the file I would like it to echo "working" AND if the file "out.txt" does NOT contain "�" anywhere in the file then I would like it to cat out.txt






linux bash grep scripting




linux bash grep scripting






share|improve this question







New contributor




Stuart Sloan is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











share|improve this question







New contributor




Stuart Sloan is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.









share|improve this question




share|improve this question






New contributor




Stuart Sloan is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.









asked 31 mins ago









Stuart Sloan

112




112




New contributor




Stuart Sloan is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.





New contributor





Stuart Sloan is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.






Stuart Sloan is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











  • It looks correct, it should work (btw, I have no font for your unicode character to see, but none of them has any special meaning). grep long understands unicode (which makes it much slower, so to search for ascii strings, a LANG=C grep is a huge performance improvement).
    – peterh
    22 mins ago

















  • It looks correct, it should work (btw, I have no font for your unicode character to see, but none of them has any special meaning). grep long understands unicode (which makes it much slower, so to search for ascii strings, a LANG=C grep is a huge performance improvement).
    – peterh
    22 mins ago
















It looks correct, it should work (btw, I have no font for your unicode character to see, but none of them has any special meaning). grep long understands unicode (which makes it much slower, so to search for ascii strings, a LANG=C grep is a huge performance improvement).
– peterh
22 mins ago





It looks correct, it should work (btw, I have no font for your unicode character to see, but none of them has any special meaning). grep long understands unicode (which makes it much slower, so to search for ascii strings, a LANG=C grep is a huge performance improvement).
– peterh
22 mins ago











1 Answer
1






active

oldest

votes

















up vote
5
down vote













try 



grep -oP "[^x00-x7F]"


if .. then statement as follows:



if grep -oP "[^x00-x7F]" file.txt; then
 echo "grep found something"
else
 echo "not found"
fi


Explanation💡:



[^x00-x7F] is a regex to match a single non-ASCII character.
[[:ascii:]] - matches a single ASCII char
[^[:ascii:]] - matches a single non-ASCII char


in bash



LC_COLLATE=C grep -o '[^ -~]' file





share|improve this answer






















    Your Answer







    StackExchange.ready(function()
    var channelOptions =
    tags: "".split(" "),
    id: "106"
    ;
    initTagRenderer("".split(" "), "".split(" "), channelOptions);

    StackExchange.using("externalEditor", function()
    // Have to fire editor after snippets, if snippets enabled
    if (StackExchange.settings.snippets.snippetsEnabled)
    StackExchange.using("snippets", function()
    createEditor();
    );

    else
    createEditor();

    );

    function createEditor()
    StackExchange.prepareEditor(
    heartbeatType: 'answer',
    convertImagesToLinks: false,
    noModals: false,
    showLowRepImageUploadWarning: true,
    reputationToPostImages: null,
    bindNavPrevention: true,
    postfix: "",
    onDemand: true,
    discardSelector: ".discard-answer"
    ,immediatelyShowMarkdownHelp:true
    );



    );






    Stuart Sloan is a new contributor. Be nice, and check out our Code of Conduct.









     

    draft saved


    draft discarded


















    StackExchange.ready(
    function ()
    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f474709%2fhow-to-grep-for-unicode-in-a-bash-script%23new-answer', 'question_page');

    );

    Post as a guest

















    1 Answer
    1






    active

    oldest

    votes








    1 Answer
    1






    active

    oldest

    votes









    active

    oldest

    votes






    active

    oldest

    votes








    up vote
    5
    down vote













    try 



    grep -oP "[^x00-x7F]"


    if .. then statement as follows:



    if grep -oP "[^x00-x7F]" file.txt; then
     echo "grep found something"
    else
     echo "not found"
    fi


    Explanation💡:



    [^x00-x7F] is a regex to match a single non-ASCII character.
    [[:ascii:]] - matches a single ASCII char
    [^[:ascii:]] - matches a single non-ASCII char


    in bash



    LC_COLLATE=C grep -o '[^ -~]' file





    share|improve this answer


























      up vote
      5
      down vote













      try 



      grep -oP "[^x00-x7F]"


      if .. then statement as follows:



      if grep -oP "[^x00-x7F]" file.txt; then
       echo "grep found something"
      else
       echo "not found"
      fi


      Explanation💡:



      [^x00-x7F] is a regex to match a single non-ASCII character.
      [[:ascii:]] - matches a single ASCII char
      [^[:ascii:]] - matches a single non-ASCII char


      in bash



      LC_COLLATE=C grep -o '[^ -~]' file





      share|improve this answer
























        up vote
        5
        down vote










        up vote
        5
        down vote









        try 



        grep -oP "[^x00-x7F]"


        if .. then statement as follows:



        if grep -oP "[^x00-x7F]" file.txt; then
         echo "grep found something"
        else
         echo "not found"
        fi


        Explanation💡:



        [^x00-x7F] is a regex to match a single non-ASCII character.
        [[:ascii:]] - matches a single ASCII char
        [^[:ascii:]] - matches a single non-ASCII char


        in bash



        LC_COLLATE=C grep -o '[^ -~]' file





        share|improve this answer














        try 



        grep -oP "[^x00-x7F]"


        if .. then statement as follows:



        if grep -oP "[^x00-x7F]" file.txt; then
         echo "grep found something"
        else
         echo "not found"
        fi


        Explanation💡:



        [^x00-x7F] is a regex to match a single non-ASCII character.
        [[:ascii:]] - matches a single ASCII char
        [^[:ascii:]] - matches a single non-ASCII char


        in bash



        LC_COLLATE=C grep -o '[^ -~]' file






        share|improve this answer














        share|improve this answer



        share|improve this answer








        edited 3 mins ago

























        answered 23 mins ago









        Goro

        8,38054282




        8,38054282




















            Stuart Sloan is a new contributor. Be nice, and check out our Code of Conduct.









             

            draft saved


            draft discarded


















            Stuart Sloan is a new contributor. Be nice, and check out our Code of Conduct.












            Stuart Sloan is a new contributor. Be nice, and check out our Code of Conduct.











            Stuart Sloan is a new contributor. Be nice, and check out our Code of Conduct.













             


            draft saved


            draft discarded














            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f474709%2fhow-to-grep-for-unicode-in-a-bash-script%23new-answer', 'question_page');

            );

            Post as a guest
































































            Comments

            Post a Comment

            Popular posts from this blog

            What does second last employer means? [closed]

            Image
            Clash Royale CLAN TAG #URR8PPP .everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty margin-bottom:0; up vote -3 down vote favorite Say, for example I have worked in the following companies, Company A => 2010 - 2011 Company B => 2011 - 2012 Company C => 2012 - Till Date Company D => Have offer Now assume Company D is asking to submit documents from my second last employer. So from the list of companies given, which company would be qualified as second last employer? software-industry employer share | improve this question asked Aug 10 '14 at 5:16 Rajaprabhu Aravindasamy 559 1 6 13 closed as off-topic by Jim G., jmort253 ♦ Aug 11 '14 at 1:58 This question appears to be off-topic. The users who voted to close gave this specific reason: "Questions seeking advice on company-specific regulations, agreements, or policies should be directed to your manager or HR department. Questions that address...
            Read more

            Installing NextGIS Connect into QGIS 3?

            Image
            Clash Royale CLAN TAG #URR8PPP .everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty margin-bottom:0; up vote 1 down vote favorite Just acquired free version of NEXTGIS and trying to install the plugin for QGIS. It tells me it was not designed for version 3 of QGIS. How do I set up the QGIS-NEXTGIS interface then? qgis qgis-plugins nextgis share | improve this question edited 3 hours ago PolyGeo ♦ 51.9k 17 77 233 asked 4 hours ago IanGS 16 4 New contributor IanGS is a new contributor to this site. Take care in asking for clarification, commenting, and answering. Check out our Code of Conduct. add a comment  |  up vote 1 down vote favorite Just acquired free version of NEXTGIS and trying to install the plugin for QGIS. It tells me it was not designed for version 3 of QGIS. How do I set up the QGIS-NEXTGIS interface then? qgis qgis-plugin...
            Read more

            Confectionery

            Image
            Prepared foods made with a lot of sugar or other cabohydrates "Sweetmeat" redirects here. For the racehorse, see Sweetmeat (horse). Not to be confused with Sweetbread. This Kransekake is a traditional Scandinavian baker's confection. Confectionery is the art of making confections , which are food items that are rich in sugar and carbohydrates. Exact definitions are difficult. [1] In general, though, confectionery is divided into two broad and somewhat overlapping categories, bakers' confections and sugar confections. [2] Bakers' confectionery, also called flour confections , includes principally sweet pastries, cakes, and similar baked goods. Sugar confectionery includes candies ( sweets in British English), candied nuts, chocolates, chewing gum, bubble gum, pastillage, and other confections that are made primarily of sugar. In some cases, chocolate confections (confections made of chocolate) are treated as a separate category, as are sugar-free versions of ...
            Read more